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CORRIGENDA 


(1) S. Rusutron, Biometrika (1952), 39 302. 


p. 305. Equation (17) should read: 
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+ “eu (= 11 nt ) 





2 °2’2n—2+8)° 
p. 306. Equation (18) should read: 
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u? = né®/((2n—2) +2) = 


(2) H. Ruspen, Biometrika (1954), 41, 200. 


is 


. 202, right-hand side of equation (16): for L/T™-) read Ti Br, 
p. 203, 3rd line and in equation (20): for L™=0 read L™=0. 


p. 203, right-hand side of equation (24): for Qgx41 9:4, TCAD gypsy of: 


p. 205, under s = 4: for ad,9(a)=1 read a,.(a)= = 


p. 208, 3rd line from bottom: insert *, before (0;a;f,y) 


. 209, 2nd line, right-hand side of equation: insert 3 before (0;1;8,y) 


. 209, 8th line, right-hand side of equation: for e* read e-*4, 


P 

P 

p. 213, Ist line: omit words ‘surface contents of’. 

p. 215, last line but one before §3: for YW, read VY, 

p. 216, 6th line from bottom: for f+y+ 1-flats read £+y-—1-flats. 
P 


. 218, right-hand side of equation (86): for (—)4+” read (—)?’. 
1 
p. 219, right-hand side of equation (90): for Sa5-p3(y—-A) read 


Qf+y-1 


. 219, right-hand side of equation (91): for -—4... read (—)7}.... 


(—)"4(8- 


. 219, right-hand side of equation (92): for -—(f—y)... read (—)’(P—y).... 


p 

Pp 

p. 219, last line of main text: for 3,4,5,... read 2,3,4,.... 

p. 225, under n = 45,r = 9: for 5894-774748 read 5894-77484 8. 
Pp 


. 227, reference to SCHLAFLI: insert footnote symbol, +, after ‘Kontinuen’. 
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THE DESIGN OF AN EXPERIMENT IN WHICH CERTAIN 
TREATMENT ARRANGEMENTS ARE INADMISSIBLE 


By D. R. COX 
Statistical Laboratory, University of Cambridge 


1. INTRODUCTION 

Consider an experiment in which the experimental units are arranged in sets of k units, a set 
corresponding, for example, to a single production run of an industrial process. Suppose 
also that the k units in each set are arranged in order corresponding to the first, second, etc., 
period of the set. If there are both systematic differences between periods and an appreciable 
component of veriance between sets, an experiment to compare a number of treetments, 
using these experimental units, would ordinarily be arranged in a Latin or Youden square, 
chosen to eliminate differences between periods and sets. Suppose, however, that for prac- 
tical reasons there is a restriction on the order of treatments within each set, such as that 
the level of the treatment must not decrease from one period to the next in a set. Then 
Latin and Youden squares cannot be used. This paper is concerned with designs for such 
a situation; the method of construction is described and designs are listed for a few special 
cases. I have not hesitated to suggest designs that are nearly optimum whenever the 
determination of the strictly optimum design would be a very lengthy process. 

The particular application for which this work was done concerned the properties of 
alloys cast from high-purity metals. Because of the high cost of the raw materials it was 
especially important to use an efficient experimental design. From a 20\b. melt it was 
possible to cast four 51b. ingots, the smallest size convenient for further processing before 
testing. (In the language of the first paragraph the melt is a set, and the four ingots are the 
periods within a set, so that k = 4.) After an ingot had been cast, the composition of the 
remaining molten metal could be changed only by the addition of one of the alloying metals, 
no technique being available for selectively reducing the concentration of an alloying 
element. Therefore we have just the situation 2escribed above, in which the level of treat- 
ment cannot decrease from one period to the next in a set. 

A further similar application is to certain large-scale experiments in steel-works, in which 
it is possible to tap several ladles from one cast of an open-hearth furnace. The effect of the 
addition of several elements could, with the present designs, be investigated by varying the 
chemical composition in successive ladles, rather than by the more costly and cumbersome 
procedure of varying the composition from cast to cast. 


2. A SIMPLE CASE 


Suppose that we wish to compare two treatments, A_, and A,, that k = 4 and that if A, 
occurs in one period of a set, all subsequent periods of that set must carry A,. The only 
admissible sequences are: 


Type Period 1 Period 2 Period 3 Period 4 
1 A, _ ‘A, dws 
2 A, A, he A, 
3 as A_, A, A, 
4 A, A A, A, 
5 A, A A A 
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and the most general design is formed by taking n, sets of type i, with n,+...+n, = N 
sets in all. Note that the treatment in period 1 is usually A_, and in period 4 is usually Aj. 
Therefore some confounding of the treatment differences with periods is irievitable, unless 
only sequences | and 5 are used, in which case treatment differences are completely con- 
founded with sets. Similarly some confounding with sets is inevitable, unless treatment 
differences are completely confounded with periods. 

It will be assumed that the analysis of the results of such an experiment can be based on 
a linear set-up, in which any observation, y, is 


(general mean) + (const. for set) + (const. for period) 


+ (const. for treatment) + (random term), 


where the random terms are uncorrelated and have zero mean and variance o?. 

We shall first suppose that differences between sets and periods are to be eliminated 
completely. The best linear unbiased estimate, 4”, of the treatment effect is obtained by 
the method of least squares and has variance Ao?, where A depends only on the design, 
i.e. ON 24, ...,%. The best design is that which minimizes A for given VN. 

To do the minimization, it is convenient to consider the problem as one of analysis of 
covariance. Introduce a concomitant variable, z, taking values — 1 whenever A_, is applied 
and 1 whenever A, is applied. The analysis of covariance of y and x, regarding the experi- 
ment as a two-way (set x period) arrangement, is 


s.s. of y s.P. of x, y s.s. of x 
Between sets S(y,y) S(x,y) S(x, 2x) 
Between periods Pty, y) P(zx,y) P(x, x) 
Residual Rty, y) R(x, y) R(x, x) 
Total T(y,y) T (x,y) T(x, 2) 


By the theory of analysis of covariance, the residual regression coefficient R(x, y)/R(x, x) 
is $4”, and by the formula for the variance of a regression coefficient 


fsx (1) 


var (44) = Sean 





Thus we require to maximize R(z,x) given N. First, it is clear by symmetry that for an 
optimum design n, = n;, n, = 4. Therefore 


T (a,x) = 4N = 4(2n,+2n,+n3) and S(x,x) = }(2n,.16+2n,.4+n,.0), 


since there are, for example, n, runs each with a total of — 4 and n, each with a total of 4. 
We can find P(z, x) similarly and thus get R(x, x) by subtraction. The answer is 


NR(x, x) = 12n, nz. + 8n, Nz + 6ngnz + 4n3. (2) 


Now maximize N R(x, x) for fixed N introducing a Lagrange multiplier ~. The solution of 
the resulting linear equations is n, = }u, ny = ns = $y. 








%, 2%) 


ran 
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The simplest case in which these equations have a solution in integers isn, = 1,n, = m3 = 2 
and hence the simplest design minimizing the variance per observation is 





A_; A_, A_, A_, 
aA A_; A_, A, 
A_; Ay A_, A, 
A_, A_, A, A, (3) 
A_, AY A, A, 
A_, A, A, A, 
A_, A, A, A, 
A, A, A; A, 
To use the design the order of the sets should be randomized. 
Now R(x,x) = 10 so that var (4) = 202, (4) 


and o? may be estimated from the residual mean square of y adjusting for regression on z, 


i.e. by the formula 
ai ] R(x, 
62 = =| Ry,y)-—" |. (5) 





~ Ria, x) 

There are a number of designs with which (4) may be compared: 

(a) if the treatments are randomized over eight sets subject only to the requirement 
that each treatment occurs twice in each set and four times in each period, the variance of 
the: estimate of the treatment effect is {0?; this design does not satisfy our basic requirement 
but may be considered for comparison; 

(b) if the component of variance between sets is o?, the variance of the mean observation 
on a set is of + 40%, so that if four sets are done with constant treatment A_, and four with 
constant treatment A,, the variance of the estimate is 40? +402. 

This shows that if the design (3) and the estimate d” are used when o <0, there is an 
appreciable loss of accuracy compared with the simple design in which the treatment is 
kept constant in each set. This loss arises from the non-orthogonality with periods and sets; 
the period differences are systematic, so that information confounded with them is lost, 
but set differences may, after randomization, be regarded as additional random variation. 
Hence a second estimate dé, uncorrelated with @, may be derived from the regression 
coefficient between sets in the analysis of covariance. Thus 

















S(x,y) 
wy = — 6 
3a Sa, x)’ (6) 
)-_% _% (7) 
var (44 ) = S(@, 2) = 12” 
where o? = o? + 40? is the variance of the set totals on a unit basis and is estimated by 
ne _ | S?(x, y) 
Price * 8 
Os 6 [ sw. y) S(a, x) ( ) 
We combine @” and @® into a single estimate 4, where 
-i 
4g (75,7 an. SE?) a) (AB?) (9) 
Oo; Or 0; os 
_ , (Rw, x) _ S(x,)\-) _ 207(0F + 407) 
var (4) = 4( a + a ) = lle? +2002 ’ (10) 


neglecting errors in weighting. 


19-2 
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In particular when of = 0, var (4) = 4,02, showing a substantial reduction from (4), 
and indicating that recovery of information is a worth-while process in this case. Also var (4) 
is less than-$0? + 407, the variance in design (6) above, when o7/0? > }. 

To sum up, the design (3) should be used only when an appreciable component of variance 
between sets is expected and information contained in the set totals should be recovered 
unless 07 < oj. 

If practical conditions demand the use of a number of sets other than 8, or a multiple of 8, 
(2) may be used to determine the best values of n,, n, and ng. 

Optimum designs similar to (3) may be found for other values of k. Two examples are 


k=2 k=3 
A, A, A_, A, A 
A_, A, A, A, A, 
A_, A, A_, A, A, 
A, 4, A, A, A, 
A, A, A, 
A, A, A, 


In the preceding analysis it has been assumed that two fixed treatments are to be com- 
pared. If, however, the linear regression on a factor that may be varied continuously is 
required, the concomitant variable, x, is no longer confined to two values. If, for practical 
reasons, the level of the factor must lie between an upper and a lower limit, these may be 
made to correspond to x = + 1; any admissible set of k treatments is then defined by.anon- 
decreasing sequence of k terms, all between + 1. Although I have not obtained a formal proof, 
it is probably true that so long as only the linear effect is required, the designs in which only 
the lower and upper levels appear are still optimum. 


3. A 23 FACTORIAL DESIGN 


As an example of the design of a more complicated experiment, consider a 2° factorial 
experiment in sets with four periods per set, assuming that the three-factor interaction is 
unimportant and that the level of each factor must not decrease from period to period 
within a set. Introduce six concomitant variables x,, %2, Xs, % (= %~g), V5 (= %g,) and 2% 
(= 2) to represent the main effects A, B, C and the two-factor interactions BC, CA, AB. 
Thus 2, takes values + 1 according as B is at its upper or its lower level and x, equals 1 for 
the combinations A_,C_,, A,C, and —1 for the combinations A_,C,, A,C_,. Twice the 
residual regression coefficient of y on x; is thus 4, the least-squares estimate of the corre- 
sponding main effect or interaction. 

Let R,; denote the residual sum of products of x, and z; in the analysis of covariance and 
R,{y) the residual sum of products of x, and y. Then the column 4” of estimates, and their 
variance-covariance matrix, are given by 


Ra” = 2R(y), (11) 
var (4) = 4R-102. (12) 

We have now to choose the design to satisfy conditions on R-; in particular we require 
the diagonal elements of R-! to be small, especially those associated with the main effects. 


In a design in eight sets with one factor, (4) gives var (4”) = 20%. If several factors are 
investigated simultaneously the variance of a main effect cannot be less than the minimum 


E 
) 


ots. 
are 


This gives the design 
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variance obtained when that factor is investigated by itself. Therefore if we can find a design 
in eight sets for which the variance of a main effect is inappreciably greater than $02, this 
design is effectively optimum for the estimation of main effects. 

A common-sense procedure for eight runs is to arrange that each factor separately has 
the design (3) and that the factor combinations are distributed as symmetrically as possible. 
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A,B,C, A,B,C, A,B,C, A,B,C, 
2.3.0, 4.50 4.45 6 
4,8 0; 2220. 2a ae 
A,B,C, A,B,C, A,B,C,  4,B,C,| al 
400 Ae eee ee 
A_,B_,C_, A,B,C, A,B,C, A,B,C, 
Aighhi C4); digs <hgliey. vik 
4,950, BROF HBL Bae 





The matrix R of residual sums of products can be found easily. Main effects are orthogonal 
to interactions, i.e. the residual sum of products of any one of 2,, 2, 7, with any one of 
%4, X;, X_ is zero. Thus R can be partitioned into two 3 x 3 matrices whose inverses may be 
found separately, i.e. 


AR, i 0 R;!: 0 
ae oe re ol) 
0 :R 0 : R;? 


10 2 -2 1 6 -1 1 
where n~( 3... .10 -2), R= 3,(— ). 


A 6 
-2 -2 10 mt Ty Qe 
22 -2 4 ,{/s 1-3 
R= (2 2 4), Rt=5( 1 5 -3). (14) 
4 48 me SideReel 


Thus the variance of the estimate of a main effect is 340? = 302, which is inappreciably 
greater than 202, the variance in a single-factor design. Hence (13) is effectively optimum 
for estimating main effects. 

The recovery of information between sets will not be considered in detail, because with 
one replicate of the design only a single degree of freedom is available for estimating o°. 
If several replicates are done, recovery of information should be considered. From the set 
totals in (13) estimates may be formed of a,—a,, a; but not of a,, a, separately. Hence if 
(13) is repeated the names of the treatments should be changed. 

With eight sets an alternative arrangement to (13) is with the treatments held constant 
in each set, each of the eight combinations in the 2* experiment occurring once. The variance 
of the estimate of a main effect is then 4(0? + 402). Therefore (13) is the more accurate only if 


3-2 S38 
50; < 301+ 40;, 


i.e. if of > 302. (15) 








292 Experimental design where treatment arrangements are inadmissible 


4. THE ESTIMATION OF CURVATURES 


If it is required to estimate the curvature of the response to a factor in addition to the 
linear effect, we may introduce two concomitant variables for each main effect, the first, x’, 
representing the linear component and the second, x”, the curvature. Thus with a factor at 
three equally spaced levels A_,, Ay, A,, x’ takes values —1, 0, 1 and z” values 1, —2, 1. 
Unless k and the number of factors are very small the number of possible designs is large and 
a formal mathematical analysis to determine the best design is rarely practicable. 
However, when k is even we can write down a pair of sets from which the curvature may 

be estimated directly. Thus for k = 4 

A_, A., Ag A, 

Ag A, A, Py, 
gives an estimate of curvature from the difference of the observations on A_,, A, and those 
on A». This estimate is clearly unaffected by period and set differences. Further, if a second 
_ factor B is superimposed on (16) according to the pattern 


B 1 B, B, Py 


(16) 


BB, B, B, B, 
the estimate of the curvature of A is unaffected by the main effect of B and by the linear- 
linear component of the interaction AB. 

These results can be used in various ways by building up more complicated designs from 
the above pairs of sets. For example the following design in four sets is formed by inter- 
changing A and B in the second pair: 

4.,B., A,B, A,B, A,B, 

4A B., AgB., A,B, A,B, 

a8. 438. 4h Wat 

4.,B, 4.,B, A.B, A,B, 
If this design is analysed neglecting all interactions except the linear-linear one, the variance 
of a linear main effect is 402, of the curvature of a main effect (defined as the regression 
coefficient of the response on x") is ;8,02 and of the linear-linear interaction is }0?. Apart 
from the two curvatures, which are very slightly correlated, all estimates are independent. 
The most accurate estimate of the linear effect obtained in (3) with eight sets has a variance 
zo? and hence the minimum variance in four sets is }o?. The increase in variance due to 
the inclusion of an estimate of curvature is not as large as might be expected. The accuracy 
of the linear effect relative to that of the curvature may be increased by the addition to 
(18) of sets derived from (3). 

Another possibility is to introduce into the 2° experiment, (13), two new factors D and 
E whose curvature only is to be investigated. Hold D and £ at their middle levels except 
in sets 2, 3, 6 and 7, and in these sets vary them in the following way: 

Set2 D_,H, D_.H, D,E, Dok, 
3 DE, DoE, DoE, DoH; 
6 DB, DoE, D,E, D,E,\° 
7 DoH, DoH, DoH, Doky 
There is now a small amount of confounding with the interactions of A, B, C, but the loss of 
information is slight. 


(17) 


(18) 


(19) 





yy ~~ Fs 9 








(19) 


oss of 
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The number of possible designs is very large, and it is impossible to give a thorough 
account in a general paper such as this. The method is to decide how many factors are to 
be investigated, the number of sets available and the relative importance of linear effects 
and curvatures. Then build up from basic designs, such as (17), an arrangement with as 
much ‘balance’ as possible, and work out the matrix of the variances of the estimates. 
Next compare with simple designs such as (3) to see that too much accuracy has not been lost 
by the inclusion of extra factors. With practice this can be done fairly quickly, but clearly 
the work is only worth-while when economy in the design is of great importance. 


5. ANALYSIS OF OBSERVATIONS 


The analysis of the observations from one of the above designs is essentially a straight- 


forward process of multiple analysis of covariance, with the simplification that the matrix 
of sums of squares and products of the concomitant variables usually takes a simple form 
and can always be obtained and inverted beforehand. Also the concomitant variables are 
restricted to small integral values and sums of products with them can be formed rapidly. 

Table 1 gives the analysis for the 2° design (13). Fictitious observations have been con- 
structed by taking the main effects of A, B, C to be 2, — 2, 1 and the interactions to be zero. 
The uncontrolled variation has been represented by period differences, by a random varia- 
tion between. sets of standard deviation 2, and by a random variation from unit to unit of 
standard deviation 1. A constant has been added to make all the observations positive. 

Figures in bold type are constants for the design and may be entered before the obser- 
vations are obtained. The procedure should be clear from the following notes: 

(1) First form the analysis of variance of the observations, y. into correction, between 
sets (rows), between periods (columns) and residual. 

(2) Then find the total sums of products of y with the six concomitant variables. For 
example z,, takes values 1 for B,C, and B_,C_, and —1 otherwise. It is desirable to form 
the total sum of products separately by rows and by columns to obtain a check. Thus, by 
rows, Ly ttas = — 3-92 — 6-44 47-87 +...—6-92—7-35 = 48-66. 

(3) The sum of products for sets is obtained from the sum of products of the set totals 
of y and the concomitant variable. Thus for z,, it is 

1(20-36 x 4+ 27-50 x 4) = 47-86. 
Similarly for periods. In this way the full analysis of covariance table is obtained, cal- 
culating the residual term as total + correction — rows — columns, since the individual 
terms have not be corrected. 

(4) The estimates of the regression coefficients are formed by multiplying the residual 
sums of products by the appropriate coefficients, obtained from (14), given in bold type. 
Thus the regression coefficient on 23, is 

del x (— 1-035) +5 x (— 8-605) + (—3) x (— 2-06)] = — 0-3946. 
The sum of squares for regression is obtained as the sum of products of the regression 
coefficients with the corresponding residual sum of products, and may, in this instance, 
be collected separately for rain effects and for interactions. Thus, for main effects, the sum 
of squares is 
1-2895 x 9-705 + (— 1-4718) x (— 12-385) + 0-1230 x 1-595 = 30-9390. 


This leads to an analysis of variance from which the error variance is estimated by 1-3845 
with 15 degrees of freedom (the population value is 1). 








Table 1. Analysis of 2° experiment 
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A_,B,C_, 3-92 A_,B,C_; 6-44 A_,B,C, 7-87 A_,B,O, 9-81 
A_,B_, = 5-13 A_, B,C, 2-99 A_,B,C, 3°87 A,B,C, 8-37 
A_,B_,C_, 410 _,B,C_, 1-89 A_,B,C_, 5-27 A,B,C, 8-27 
A_,B_,C_, 7-07 A_,B_,C_, 5-81 A,B,C_, 9-22 A,B,C_, 8-80 
A_,B_,C, 10-78 A_,B_,C, 901 A,B,Q, 9-01 A,B,O, 12-13 
A_,B_,C_, 5-66 A,B_,C_, 17-86 A,B_,C_, 8-35 A,B,C, 5-63 
A_,B_,C_, 2-97 A,B_,C, 7-29 A,B_,C, 8-68 A,B,C, 7-68 
A,B_,C_,; 5-90 A,B_,C_, 5°75 A,B_,C, 6-92 A,B_,C, 7°35 
Set (row) totals 
Set y at a) Zs Leos %31 V2 
1 28-04 —4 4 0 0 0 —4 
2 20-36 —2 2 2 4 0 0 
3 19-53 —2 2 —2 0 4 0 
4 30-90 0 0 —4 0 0 4 
5 40-93 0 0 4 0 0 4 
6 27-50 2 —2 —2 4 0 0 
7 26-62 2 —2 2 0 4 0 
8 25-92 4 —4 0 0 —4 
219-80 0 0 0 8 8 0 
Period (column) totals 
Period y ay Ly Xs Zag X31 9 
1 45-53 —6 -6 -6 a 4 4 
2 47-04 —2 —2 —2 0 0 —4 
3 59-19 2 2 2 0 0 —4 
4 68-04 6 6 6 4 4 4 
219-80 0 0 0 8 8 0 
Analysis of covariance 
y? YX, YX, YX, YXo3 YX, YX DF 
Correction 1509-7512 0 0 0 54-95 54-95 0 1 
Sets 1587-2470 4-995 —4:995 10-005 47-86 46-15 17-87 8 
Periods 1552-3300 19-92 19-92 19-92 56-785 56-785 3-67 4 
Residual 55-2266 9-705 — 12-385 1-595 — 1-035 — 8-605 — 2-06 21 
Total* 1685-0524 34-62 2-54 31-52 48-66 39-38 19-48 32 
* Checked by columns and by rows. Note that terms for sets and periods are uncorrected. 
6 -1 i 1 —3 
1 1 
—{—1 6 1 —: 5 -—3 
* ( 1 1 ) a (_ 3 = 3) 
Regr. coeff. 1-2895 -—1-4718 0-1230 —0-0792 -—0-3946 —0-0206 
Contr. to s.s. 12-5146 18-2282 0-1962 0-0820 3-3955 00424 
Variance 0-1483 0-1483 0-1483 0-0721 0-0721 0-2163 
St. error 0-3851 0-3851 0-3851 0-2685 0-2685 0-4651 
D.F. y* Mean square 
Regr. on main effects (7,, 2, x3) 3 30-9390 10-3130 
interactions (725, 733, V2) 3 35199 1-1733 
Error 15 20-7677 1-3845 
Residual (uncorrected for regr.) 21 55-2266 — 
Main effects Interactions 
A B C ‘BC CA AB 
Estimate 2-5790 — 2-9436 0-2460 —0-1584 — 0-7892 —0-0412 
St. error 0-7702 0-7702 0-7702 0-5370 0-5370 0-9302 
True value 2 —2 1 0 0 0 
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(5) The variances of the regression coefficients are obtained by multiplying the error 
variance by the appropriate diagonal element of the matrices of coefficients. Confidence 
limits (or significance tests) for an individual regression coefficient follow from the ¢ distribu- 
tion in the usual way. 


(6) Main effects and interactions are twice the corresponding regression coefficients. 


6. Discussion 
We have considered experimental design in a special situation where practical conditions 
severely limit the treatment arrangements that may be used. The limitation makes a sub- 
stantial amount of non-orthogonality inevitable if certain portions of the uncontrolled 
variation (set and period differences) are to be eliminated from the error. 
The following remarks are relevant to the application of the designs developed above and 
of other designs that may be worked out for similar situations: 
(i) The design of even a simple experiment to compare two treatments requires care. 
(ii) The number of factors that may be examined simultaneously is restricted. 
(iii) It is better not to attempt to eliminate set differences unless there is an appreciable 
component of variance between sets (§§ 2, 3). 
(iv) The correct method of analysis must be used, but this is usually straightforward 
once the sequence of calculations has been grasped. 
(v) Finally, it must be repeated that the situation is a complicated one and that the 
use of special designs, while sometimes very well worth while, is usually only justified when 
economy in the experimental material is of great importance. 


I am very grateful to Dr C. J. Anson, G. K. N. Group Research Laboratory, for suggesting 
the problem and for providing the description of the application, and to Dr J. Wishart for 
helpful comments on the draft of the paper. 









7PM? SF PPAR oa 


Fyre, w Fy Ue 





[ 296 ] 


THE ESTIMATION OF LOCATION AND SCALE PARAMETERS 
FROM GROUPED DATA 


By J. M. HAMMERSLEY} anp K. W. MORTON{ 


We shall describe a method of estimating the location and scale parameters of an arbitrary 
continuous distribution, when the data consist of the numbers of observations (in a sample) 
falling within arbitrary specified intervals of the variate. The method is closely allied to 
that given by Lloyd (1952) for estimating these parameters, when the data comprise order 
statistics; and such novelties as our method possesses consist only in (i) adopting a slightly 
different viewpoint of the data so that they may be looked upon as grouped rather than 
ordered, and (ii) introducing approximations which considerably simplify the numerical 
analysis. Mosteller (1946) discusses some related topics. 

We found the method particularly suitable in the following circumstances, which we 
describe in general terms partly to help to fix the ideas and partly because similar 
demanding circumstances may arise in other contexts. In an experiment on the ionization 
loss of relativistic ~-mesons in neon (Eyeions et al. 1954) a sample of observations was 
taken under each of several experimental conditions. Theory suggested that, although 
the parent distributions of the different samples were all different and all of unknown 
functional form, they would differ only in being linear transforms of each other; and the 
object of the experiment was to discover how their location and scale parameters depended 
upon the experimental conditions. By taking a very large sample under fixed experimental 
conditions it was possible to get an empirical picture of the shape of the cumulative dis- 
tribution function; but it was not practicable to take large samples under the remaining 
experimental conditions. Indeed, the data from the several small samples could only be 
gathered in irregular and relatively coarse groups. The shape of the distribution (found from 
the large sample) appeared to be very skew, observations in the tails of the distribution 
seemed so erratic that arbitrary truncation seemed advisable, and one of the tails was so 
long as to render estimating location by an arithmetic mean quite unreliable. Further, 
although we had a fair picture of the empirical cumulative distribution function from this 
large sample, it would barely stand one numerical differentiation to give a representation 
of the shape of the probability density function, and certainly not two differentiations. 
Hence any form of maximum-likelihood estimation was out of the question. Minimum 
x* estimation was a possibility; but, particularly here where two parameters had to be 
estimated simultaneously for each of a number of small samples, the numerical labour of 
that method was discouragingly heavy; and, moreover, it was not obvious how to derive 
standard errors of the resulting estimates. 

Let F(x) denote the (true unknown) cumulative distribution function of the large sample; 
and let F(a + fx) be the corresponding cumulative distribution function of a given small 
sample. Here « and / are unknown parameters to be estimated. Suppose that the intervals, 
characterizing the grouping of the small sample, are z,;_,<z<-2, (i = 2,3,...,N). These 
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x; are known; and we shall suppose that (before truncating the sample, if truncation occurs) 
each group contains at least one observation, and in particular that there is at least one 
observation less than or equal to x, and at least one observation greater than zy. This 


‘requirement can always be met by amalgamating groups if necessary. Suppose that the 


small sample contains m observations before truncation (if that is necessary); and that, of 
these m observations, m; do not.exceed xz;. Define p; = m,/m; and let y; be the solution of 
F*(y,;) = p;, where F'*(z) is the observed empirical cumulative distribution function of the 
large sample. (If the functional form of F happens to be known, we may of course write F 
for F* in all that follows.) In virtue of the foregoing suppositions we have 


0<p, <pg<...<Py<l. 


We now make two approximations: (i) we suppose that the large sample gives a sufficiently 
good representation of its cumulative distribution function (though the corresponding 
probability density function may not be known nearly so well) to allow us to write 
F*(y;) = F(y;), and (ii) we suppose that in the immediate neighbourhood, over which y; 
may vary due to sampling effects, F is approximately linear, so that we may write 


é(F(y,)] = FLE(y,)). 


F(a + fu;) = &(p;) = €[F*(y;)] = &[F(y,)] = FLE(y,)], 
and hence E(y;) = a+ Ba;. (1) 


Then we have 


The method proposed now is to estimate « and f by finding the linear regression of y; on 7;. 

In carrying through this linear regression we must remember that the y; are correlated 
(say with variance-covariance matrix V), and that they will have to be weighted accordingly. 
The weights we shall obtain depend upon the first derivative of F(x); and hence will be 
somewhat inaccurate; but here, and also in finding the standard errors of a and £, we can 
accept a lower standard of accuracy than was needed in deriving (1). 

It is a standard result (Frisch, 1928; Aitken, 1935) that the unbiased minimum variance 
linear estimators a and b of a and f are given by 


(;) = (X/V-1X)-1X'V-ly, (2) 
eg ee Does el 
where X’ = My a ig Y’ = (Yr, Yo --->Yn)s 


and that the sampling variance-covariance matrix of these estimates is (K’V-'X)-1. We 
proceed to calculate V and V-1. Since we are assuming that F is approximately linear in 
the neighbourhood of y,, the elements of V are v,; = cov (y,,y;) = cov (p;,p,)/fif;, where 
f, = [0F*(x)/Ax],y,. Now m, is the number of ‘successes’ in a sample of m where the 
probability of success is &(p,); and hence approximately var m, = mp,q;, where g; = 1 — p;. 
If i <j and m, is given, then m, is the number of successes in a sample of m, where the pro- 
bability of success is &( p;)/@(p,;); and hence approximately 
&(m, | m,) = Ce) my, = Phen, 
var m,; D; 
Thus cov (m,,m,) = mp,q, for i<j; and therefore for i<j by comparison with the result 
for var m,. It follows that cov (p;,p;) = p;q,/m for i <j; and so 


U4 = Uy = P:YMff; (i<j). (3) 
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By constructing the product VV-!, it can be verified that 


a a ae eege, 0 
ae oe ae ee 0 0 
0 C. 0 0 
ag) Ye & 
0 0 Cy-1 YN-1 
S .© ©. an. Yen Oe 


where (with the conventions p, = 0, py,, = 1) 


C; = fi Pisa —Pi-r)! (Pina — Pad (P¢:—Pi-a)> Vi = —Sifesal (Pisa — Pid- (4) 


The approximations which have led up to (3) and hence allowed the explicit inversion of V 
provide the main simplification in the numerical analysis, mentioned at the outset. It is 
now easy to complete the estimation by substitution into (2). We collect the results in the 
form ofa computing recipe: 

I. Compute p; = m,/m for i = 1,2,...,N; hence determine y; such that F*(y,;) = 9,. 


and thence f; = [0F'*(x)/0x],_,,,. 
II. Compute c; (i = 1,2,...,N) and y; (= 1,2,...,N—1) from (4), where py = 0, 
Pyu = 1. 
III. Compute 
Sy 


N- N-1 


N 1 N N- 
LVat2 Dy Se= UyH+ DT VlTj+%1), 
i=1 i=1 i=1 i=1 


N N-1 N N-1 
Siz = » o,xj +2 2 WX Fis Sy = x Ys t X Vy +Yi+1) 
= = ™= ‘= 


N N-1 
S.y = a C,%,Y; + 2 VilUYi4at+2iy¥i), D = 8y,8,.—Siz- 
= = 


IV. Then the estimates of « and # are 
= (SzzS1y— S12Szy)/D, b= (Sy Sry — Sy2Syy4)/D, 
with sampling variances and covariance 
vara = S,./mD, varb=S,,/mD, cov (a,b) = —S,,/mD. 


To exhibit the analogy between the foregoing analysis and Lloyd’s work, we conclude 
by generalizing Lloyd’s argument and simplifying the appropriate numerical work. In 
contrast with our previous suppositions we now suppose that, when m is the size of the small 
sample, m; (i = 1,2, ...,.N) is a prescribed set of integers satisfying 0 < m,<m,<...< my <M; 
and we write £,; for the m,th observation when the observations are arranged in ascending 
order of magnitude. Suppose that the available data from the smali sample consists of the 
values &; (i = 1,2,...,.N) and only these values. (Lloyd considered the natural but never- 
theless special case N = m.) Instead of p; we now write 7, = m,/(m-+ 1); and we define 7, as 
the solution of F *(n,) = 7. Since F(a + £&;) is the m;th observation in an ordered sample of 
m from a rectangular distribution we have 


E(P(a+fE:)] =7;, cov[P(a+ PE), P(a+BEs)] = m(1—m;)/(m+2) (t<j). (5) 
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Hence, with the same approximations as before, 
E(E,) = (%—a)/B, cov (E;,£;) = m(1—7,)/(m + 2) f*¢, ¢; (i<j), (6) 


where $; = [0F*(zx)/0x],_,,. We now consider the regression of £; upon 9, (instead of y, 
upon 2,); and the analysis proceeds as before. 
The resulting computing recipe becomes: 
Ia. Compute 7; = m,/(m+1) for i = 1,2,...,N; and hence determine y, such that 
F*(n,) = 7, and thence ¢,; = [0F'*(x)/0x],_,,. 
Ila. Compute c, (¢ = 1,2,...,N) and y, (¢ = 1,2,..., N—1) from (4) with 7, for p, and 
¢;, for f;, where 7) = 0 and my,, = 1. 
Illa. Compute the quantities in ITI, writing 7 in place of z and £ in place of y throughout. 
IVa. Then the estimates of —af-! and f— are 


—ab™ = (S,,8y—8,,8,,)/D, b+ = (Sy Sy —8,,S,,)/D 
with estimated sampling variances and covariances 


var (—ab-) = (b-1)*8,,/(m+2)D, var(b-!) = (6)? 8,,/(m + 2) D, 
cov (ab-!, b-!) = — (b-*)? S,,/(m + 2) D. 


NUMERICAL EXAMPLE 


We illustrate the computing recipe I, ..., TV by carrying through the numerical work for 
one of the small samples in the ionization loss problem. 

Before considering the small samples, it is necessary to do a certain amount of computing 
on the large sample. This was presented as an empirical frequency function f*(y), tabulated 
at equal intervals of y. We are more concerned with comparing the small samples with each 
other than with setting an absolute standard. Hence it is.advisable to smooth f*(y), which 
we do by means of its differences. 

This is then integrated to give a table of F*(y), the proportion of observations not ex- 
ceeding y. From this, a table of y against F*(y) at equal intervals of F*(y) is prepared, doing 
the inverse interpolation by iterating the formula 


6 = [FG — FS —BY(0) (On FE + on FT) — BM (8) BFFSFF, 


as described by Hartree (1952, p. 91). 

Numerically the large sample gives the results shown in Tables 1 and 2 in which f(y) is 
a smoothed version of f*(y). 

This now enables us to deal easily with each of the small samples. We have x; and p, from 
the data, and by interpolation in Table 2 we obtain y,. From Table 1 we then get f, = f(y;) 
and the computing recipe then gives us Table 3, where m, = 0 and my,, = m, by con- 
vention. Each m, is derived from averaging over two counters, counting common events 
in parallel; this explains the occurrence of half units in the relevant column. Ap; is inserted 
for convenience in calculating c; and y;. Similarly, c;7, and y,~, are tabulated for convenience 
in accumulating the sums 


Si, = 01945, S,, = —0-1064, S,, = 1-0410, S,, = 1-2255, S,, = 0-2326, D = 0-1912. 
Thence a = 6-802, 6 ='0-919, 
vara = 0-0058, cov(a,b) = 0-0006, varb = 0-0011. 
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Table 1 Table 2 
y | f*y) Sly) | F*(y) F*(y) y F*(y) y F*(y) y 
| 
0 | 00000 | 0-0000 | 0-0000 0 0 0-10 5-452 | 0-86 | 13-239 
1 -0002 0002 | -0000 0-01 3-576 “15 5-859 +87 13-702 
2 -0013 0015 | -0007 02 | 4-113 -20 6-201 -88 | 14-226 
3 -0064 0068 | -0043 03 | 4-442 25 6-512 -89 14-822 
4 -0230 -0219 0174 04 | 4-678 -30 6-806 90 | 15515 
5 -0682 -O715 -0593 05 | 4-860 -35 7-093 91 16-363 
6 | 0-1484 | 01444 | 0-1699 0-40 7-384 
7 +1756 1745 +3338 “45 7-685 
8 +1461 1510 -4992 -50 8-005 
9 “1127 1116 -6310 “55 8-352 
10 -0732 0728 :7223 -60 8-735 
il -0506 0503 7828 -65 9-176 
12 | 0-0334 | 0-0349 | 0-8250 0-7 9-713 
13 0257 0246 +8543 ‘15 | 10-412 
14 -0193 0189 | -8758 -80 | 11-365 
15 -0147 0150 -8927 -85 | 12-829 
: 16 0106 0116 | +9060 
17 -0085 -0082 | -9160 
Table 3 
t x; m; Pi | Pir — Pi Y% | Si C; | Cy 2X, Y: Viti 
| 
| | | 
0 —6 0 0 ; 0-011 — | — -- | —_ _ _ 
| 
1 -3! 10 | 0-011 | 0-044 3-643 | 0-0147 | 0-02448 | —0-0734 | —0-02209 0-0663 
2 —-2| 652 -055 -103 4-930 | -0662 | -14219 | — -2844| — -08986 -1797 
3 —1 | 148 -158 -148 5-917 | -1398 | -32176 | — -3218 | — -16380 -1638 
4 0 | 287 -306 +154 6-840 | -1734| -39849| 0 — +17969 
5 1 | 431-5 | -460 “119 7:747 | -1596 | -37931 -3793 | — -17344 | — -1734 
6 2| 542-5 | 0-579 | 0-104 8-568 | 0-1293 | 0-30143 0-6029 | —0-11212 | —0-2242 
7 3 | 640-5! -683 -068 9-516 | -0901 | -19766 | -5930 | — -08172 | — -2452 
s 4 | 704 7151 050 | 10-427 | -0616 | -13187 | -5274 | — -05398 | — -2159 
9 5 | 7505 | -801 -032 | 11-386 | -0438 | -09828 -4914 | — -04380 | — -2190 
10 6 | 780-5 | -833 038 | 12-234! -0320/| -05898 -3539 | — -01686 | — -1012 
11 7 | 816-5 | 0-871 | 0-021 | 13-751 | 0-0200 | 0-02960 0-2072 | —0-01446 | —0-1012 
12 8 | 836 -892 017. | 14-951 | -0152 | -02453 -1962 | — -00958 | — -0766 
13 9 | 852 -909 O11 | 16-268 | -0107 | -01724 -1552 | — -00658 | — -0592 
14 10 | 862-5 | -920 080 | 17-500 | -0068 | -00471 0471 snd — 
| 
15 co | 937-5 | 1-000 aon pom a! ron pins —- ~— 
pe kd. (=m) 
| 






































To check the validity of this approach we carried out a y* goodness-of-fit test as follows: 


where 


AD, = Pini — Di 


N 
x= m Y (Ap,—AFF)P/AF7, 
i=0 


and AF# = F*(a+bz,,,)—F*(a+z,). 


Numerically x? = 12-8, and with 12 degrees of freedom this occurs near the 40% point. 
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We are indebted to Dr J. Howlett, Atomic Energy Research Establishment, Harwell, 
for calling our attention to this problem, and to Mrs B. M. Sykes and Miss A. Beard of the 
Harwell computing group, for carrying out the computation in the numerical example. 
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TRANSFORMATIONS OF THE BINOMIAL, NEGATIVE BINOMIAL, 
POISSON AND xy? DISTRIBUTIONS 


By GUNNAR BLOM 
Department of Mathematical Statistics, University of Stockholm 


1, SUMMARY AND INTRODUCTION 


Transformations of statistical variables are used in applied statistics mainly for two 


purposes. 
(i) Variance stabilization 

A transformation is applied in order to make it possible to use, at any rate approximately, 
the standard techniques associated with continuous normal variation, e.g. the methods of 
analysis of variance. 

In particular, transformations are required which stabilize the variance, that is, which 
make the variance of the transformed variable approximately independent of, for example, 
the binomial probability or the mean value of the Poisson distribution. It is, of course, 
desirable that the transformed variable, satisfying the constant-variance condition, is 
also normally distributed. As all transformations, subject to mild restrictions, are asymptoti- 
cally normal, this part of the transformation problem has in general been treated only 
superficially. The constant-variance condition has led to the introduction of the inverse 
sine, inverse sinh and square-root transformations which are used nowadays in many fields 
of applications (see the references given by Eisenhart (1947), which, together with those 
given at the end of this paper, constitute a fairly complete bibliography of this part of the 
subject.) 

(ii) Normalization 

A transformation is used in order to facilitate the computation of tail sums of the distribu- 
tion by the aid of the normal probability integral. There are two problems in this connexion, 
which are here formulated in terms of the binomial distribution but apply mutatis mutandis 
to the other distributions mentioned in the title as well (excluding the confidence problem 
which does not apply to the x*-distribution). 

The tail problem. Determination of the area of a tail of the binomial distribution; that 
is, calculation of the probability that the variable is greater than or equal to a given value 
a or less than or equal to a. 

The confidence problem. Numerical determination of confidence limits for an unknown 
binomial probability p in terms of an observed value a. 

The transformations introduced for variance stabilization have been applied by several 
authors to the last-mentioned problems, the reason for this being (i) the asymptotic nor- 
mality, (ii) the satisfactory results of empirical trials (see, for example, Paulson, 1947; 
Hald, 1952). A modification of the inverse sine transformation, known as the chordal 
transformation, has been introduced by Mosteller & Tukey (1949). Freeman & Tukey 
(1941, 1950) have also made an empirical study of both the ‘stabilization’ and ‘normal- 
ization’ effects of various formulae founded upon the inverse sine and chordal trans- 
formations. 
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A review of the literature shows that a considerable number of transformations of 
binomial, negative binomial, Poisson and x? variables have been proposed. In addition 
to those cited above, we may mention the logarithmic transformation which has been 
applied to the binomial and the x? distributions, and the cube-root transformation, which 
has been used in connexion with the Poisson and x? distributions. 

In this paper, whose contents can be summarized as follows, we shall be concerned only 
with the tail problem and the confidence problem. 

In §5 we introduce a general transformation of the binomial distribution and expand 
the transformed variable in a Cornish-Fisher (C.F.) series (Cornish & Fisher, 1937). In this 
way general solutions of the two problems mentioned above in terms of the normal pro- 
bability integral are obtained. 

In § 6 the central idea of the paper is presented, namely, to derive a transformation of the 
binomial distribution that gives the C.F. expansion the property that the term of order 
n-t (‘the skewness correction’) is as small as possible. The application of this principle leads 
to a differential equation which contains the desired transformation as a solution. In the 
following sections the same idea is applied to the Poisson, x? and negative binomial dis- 
tributions. It will be shown that the differential equations obtained in this way are satisfied 
inter alia by the following transformations: inverse sine, square root, cube root and log- 
arithmic. Thus, we shall find that nearly all the transformations used hitherto in the litera- 
ture for normalization of binomial and related variables can be developed from a common 
starting point. 

Some new transformations are also derived, which seem to be of a certain interest, at 
any rate from a theoretical point of view. For some transformations which are of more 
general interest, the C.F. series, furnishing solutions to the tail problem and the confidence 
problem, are presented. A numerical study of some of the formulae is made, and a com- 
parison with standard formulae is included. As the main purpose of the paper is, however, 
not to derive very accurate approximation procedures, but to seek for general principles, 
no systematic comparison between the host of formulae which can be applied to the tail 
problem and the confidence problem has been made. 

One of the practical conclusions of the investigations reported here is that the inverse 
sine transformation and its limiting case, the square-root transformation, may be used not 
only when stabilization of the variance is essential but also when normalization is the main 
purpose of the transformation procedure. Therefore the formulae founded upon these 
transformations may with advantage replace the classical large-sample methods for hand- 
ling binomial and Poisson variables. 

The derivation of the C.F. expansions used in the paper can be performed in different 
ways. An interesting line of approach is to utilize the relationship between the binomial, 
negative binomial and Poisson distributions on the one hand and Fisher’s z-distribution 
on the other. This method of substituting a continuous distribution for a discontinuous one 
may seem artificial at first sight but is, as we shall see, valuable for two reasons: first, because 
no question of continuity corrections arises, and secondly, because the tail problem and the 
confidence problem can then be treated uniformly. The formulae describing this relationship 
are given in §§3 and 4. 

Readers who are interested only in the results can begin with § 7 and consult the preceding 
sections when necessary. 
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2. GENERAL FORMULATION OF THE PROBLEMS 


The two problems mentioned in the introduction can be formulated in compact form as 
follows. 

Let x be a random variable. By P (x 2a; 6) we denote the probability that the variable 
is greater than or equa! to a. @ is a parameter (known or unknown, as the case may be). 
P (a =a; 6) is supposed to be a monotone function of 6 for any fixed a. Put 


P(a2a; 6) =e. (2-1) 


The tail problem arises, when ¢€ is to be calculated, and the confidence problem, if @ is 
unknown. In the latter case 1 —¢ is the confidence level (one-sided interval). 


3. THE BINOMIAL CASE 


In particular, let x follow the binomial distribution with the parameters n and p. Further, 
let the variable y be beta-distributed with f, and f, degrees of freedom so that y has the 
frequency function const, yth-1(1 —y)ife-1, 


The two distributions are connected by means of the well-known formula 





n n—1 ” aygn—-a — D(n+ 1) 7 a—1/(] —4,;\n—a . 
p*+np q+..+(")p "* WaracatiLe (3-1) 
or P(x2a; p) = Plysp; fife), (3-2) 
where fy = 2a, f, = 2(n—a+]1). (3-3) 


Using the fact that the variable aan where F has the F-distribution with f, and f, 
1 2 


degrees of freedom, is beta-distributed with the same degrees of freedom, we can write 


P(x2a; p) = P(A " SPiSuoh) ; 
1 
where f, and f, are given by (3-3). With 





was: a AVS 4s: + _ atl 2. 
el SS tdi pinp n+1 ’ (3-4) 
* 
we find P(x2za;p)=P (FFs?) = P(zsZ), (3-5) 


where z is z-distributed with the degrees of freedom given by (3-3) and 


2Z = log p/q—log p*/q*. (3-6) 
It follows from these relations that the confidence problem for a binomial variable is 
identical with a percentage point problem for a z-variable. In addition, we have replaced 


a discontinuous variable by a continuous one, which has certain advantages, as previously 
mentioned. 


4. Tue CorRNISH-FISHER EXPANSION FOR THE 2-DISTRIBUTION 


We shall now derive an important expansion by aid of the C.F. expansion of the z-distribu- 
tion. The C.F. series for a z-variable with f, and f, degrees of freedom runs as follows (cf. 
Kendall, 1946, p. 117): 


P(z<Z; fy,fe) 7” D(A), (4-1) 








4) 


5) 
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3 32 
whee °( #% a /() ~5ar+2)+ /(§) [xp +8) 4+5— a+ ua)]+..., (4-2) 


a 
and (A) = sem} e-** du is the normal distribution function. Here, for brevity, 
o = I/f,+1/f, and 6 = 1/f,—1/f,. 
Inserting the values (3-3) of f, and f, and using the notation (3-4), we find 
1 Ly Os SS Pee 


* = 2(n+ 1) p*q*’ 2(n+1) p*g* * 


We insert these expressions in (4-2) and substitute the right member of (3-6) for 2Z. 
Combining (3-5) and (4-1) and changing the sign of A, we finally obtain 


P(x2a; p) = 1—(A), (4-3) 


where a, p and A satisfy the relation 








log p/q —log p*/q* = ¢,(n + 1)-#+¢,(n+1)1 +... (4-4) 
‘ 8 A242 
with C, = —A(p*g*) +, cg = —3—(p*—9*) (p*g*), 
AB + 5A AF+11A 
Cy = ——ag— (p*q*) *+—— (p*q*) +, ete. 


The formulae (4-3) and (4-4) constitute the starting-point for the investigations in the next 
section. 


5. Tar CornisH-FISHER EXPANSION FOR A TRANSFORMED BINOMIAL VARIABLE 


Equations (4-3) and (4-4) contain, as is easily seen, solutions of both the tail problem and 
the confidence problem in terms of a normal deviate. Before we discuss the solutions of 
these problems in detail in § 6 and the following sections, we shall apply the C.F. method, 
not to log p/q—log p*/q*, but to a general function ¢(p)—¢(p*). It will later be realized 
that interesting results are obtained in this way. 

We introduce a general transformation ¢(p), where the function ¢(x) is supposed to 
define a one-to-one correspondence between points in some interval 0<a<x<b<1on the 
x-axis and a corresponding interval on the ¢-axis. Further, ¢(x) is supposed to have 
bounded derivatives ¢’(x), 6”(x), ... in the interval. By p’(¢), p’(¢), ... we denote the 
derivatives of the inverse function p = p(¢) with respect to ¢ (which are also supposed to 
be bounded). The value ¢(p*) will sometimes for brevity be denoted by ¢*. 

We shall replace (4-4) by two other expansions, both of which will be found useful in 
what follows; the first expansion can be written in the form 


O(p) = P(p*) +a,(n +1) + +a,(n+1)*+a,(n+1)*+.... (5-1) 
The coefficients a, depend upon A and p*, not upon p. We shall call this series the first 


transformation series. 
The second series to be derived in this section is of the same form 


$(p*) = A(p) +6,(n + 1)*46,(n + 1)146,(n+1)*+..., (5-2) 


where the coefficients b, only depend upon A and p, not upon p*. We call this the second 
transformation series. 


20-2 
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We begin by determining the coefficients a,. Expanding the left member of (4-4) formally 
in a Taylor series around ¢*, we find 





* 
log p/q—logp*|g* = d3(6—9*) + (6-9*)*+ (5:3) 
where d*, etc., are the quantities obtained, if p is replaced by p* in 
d, pt = Tq 
~< , = ” (5-4) 
ayn 4 Et (G++) 
"pq pt $*pq\¢' pq }” 
and so on. We determine a, a,, ... successively by inserting the series (5-1) in (5-3) and 


comparing the coefficients of (n + 1)-” in the right member of (4-4) and (5-3). We give the 
first two terms of the resulting series: 


a, = —A(p*q*) p'(p*), (5-5) 
A, = $A*[p*q*h"(p*) + (1 —k(A)) (g* —p*) 6'(p*)], 
where k(A) = att (5-6) 
3A2 * 


The coefficients 6, may be determined by inversion of (5-1) or directly by a modification 
of the above procedure as follows. We expand leg p/q—log p*/q* around ¢ instead of ¢*, 
which gives d 
2Z = log p/q— log p*/q* = —4,(9* -$) — 55 (6* - 9) + --.» (5-7) 


where d, and d, are given by (5-4). Further, the coefficients c, in (4-4) are also expanded 
around ¢. After substitution of (5-2) in the resulting series and in (5-7), the coefficients of 
(n+ 1)-* are compared. We then obtain 


b, = A(pq)* $'(p), 
bz = 4A*[pgh"(p) + (A) (q—P) o'(P)]. 
Theoretically, any transformation which gives the two series (5-1) and (5-2) reasonable 
asymptotic properties may be used for solving the problems treated in this paper. 


We finish this section by remarking that (5-1) and (5-2) can be derived directly without 
using the C.F. expansion of the z-distribution as an intermediary step. 


(5-8) 


6. DETERMINATION OF THE ‘BEST’ TRANSFORMATION OF A BINOMIAL VARIABLE 


In many practical situations only the first two terms in (5-1) or (5-2) are calculated, and the 
terms of order (n+ 1)-1 and higher order are neglected. It is then natural to choose the 
transformation ¢(p) in such a way that the term of order (n+1)-! vanishes or at least 
becomes very small. An application of this principle gives of course no guarantee that the 
total error will be small, but good results may be expected. This is also confirmed by some 
empirical calculations described later on in the text. 

The term of order (n + 1)~ is in general a function of the normal deviate A, and it is thus 
evident that the desired transformation will contain A as a parameter. This may seem 
embarrassing, particularly from the point of view of the tail problem, where our main task 
consists in calculating A. With some a priori knowledge of the area of the tail we shall, 
however, be able to overcome this difficulty. 
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The coefficient a, is given in (5-5) and may be written 


“= baprg*|$"(D") +0400) =a) on], 


A? +2 
Putting a, equal to zero and replacing p* by p, we obtain the differential equation 
$"(p) ( 1 *) 
re —! - 6-2 
(p) a,(A) is. 3 (6-2) 


In terms of a general parameter a, this equation has, apart from a multiplicative constant, 
the solution 


Pp 
$(p; a) = 2-*(1—2)-*de. (6-3) 


Po 


Starting with 6, in (5-2) and (5-8) and proceeding analogously, we find the same trans- 
formation with the parameter r242 
&(A) = k(A) = ae (6-4) 
We observe that 
@,(A)+a,(A) = 1. 
When A varies from 0 to +00, «,(A) increases from — oo to 2, and a,(A) decreases from +00 
to}. For A = 2, we have a, = a, = }. 
For obvious reasons we shall call (6-3) the beta-transformation. It is interesting to note 
that most of the transformations used hitherto in the literature are special cases of this 


transformation. This will become clear in the following sections, where special values will 
be assigned to a. 


The expansions (5-1) and (5-2) can be simplified when the beta-transformation is used. 
Substituting ¢’(p*), 6’(p*), ... by the expressions obtained by differentiating (6-3), the 


first transformation series becomes 
P(x2a; p) = 1—®(A), (6-5) 
where $(p; x) = $(p*; a)—A(p*q*)#-* (n+ 1)-# 


az =) Arn? gt —p*) (ptq*)*(n+1)4.... (66) 





If we solve with respect to A in the second term of the right member, we obtain 
2—3a)A?-2 
A= (G*— 9) (peg) (n+ 1p + FIA? ge psy (ptgty (n+ 1)4..0. (67) 


The second transformation series leads to (6-5) with 


A = (o* — g) (pq)** (n+ 1)# + 





3a—1)A*—2 
RA a P)(2q)7 (Mt IAH oe (68) 
The quantities p* and g* which appear in the formulae have been defined in (3-4). It is 
seen that the part of the expansion (6-8) reproduced here is obtained from (6-7) by replacing 
p* and q* by 7 and q and a in the second term of the right member by 1 — a. 
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The terms of order (n + i)~!in (6-7) and (6-8) have also been determined and are reproduced 
here primarily in order to provide a check for formulae published before. In both series 
(n+ 1)-? should be multiplied by the factor 


A / B 

= |A-—}. 6-9 

36 ( ‘a ii 
In (6-7) we have 


A= abe. oe pee-scmmpgammte (6-10) 
and in (6-8) 
A = [1-+12a(2a—1)]A?—48a+11, (6-11) 
B = (6a?—})A®—12«—1. 


We have hitherto only studied the right (upper) tail of the binomial distribution. The 
other tail is, of course, obtained by substituting a+ 1 for a and taking the complementary 


probability. Thus P(x Sa; p) = ®(A). (6-12) 
From (3-4) it follows that »* and qg* should now be defined by 


With this modification, the formulae (6-5)—(6-11) are true even in this case. 

The reader’s attention is drawn to the fact that the equations presented in this section 
are given in terms of n + 1, not in terms of n. Also, p* is defined with n + 1 in the denominator. 
In this way a sort of ‘automatic’ continuity correction is made which replaces the classical 
half-correction. Freeman & Tukey (1949) have introduced the same continuity correction 
from heuristic considerations. 


7. APPLICATION OF THE BETA-TRANSFORMATION TO THE CONFIDENCE 
PROBLEM FOR A BINOMIAL VARIABLE 


It is evident that the first transformation series in the form (6-6) provides the solution of 
the confidence problem. 
Let the desired two-sided confidence level be 1—2¢. Let A, be defined by 


@(A,) = l-e. (7-1) 


For a given value of « we insert A = A, and p* = a/(n +1) in the first terms of (6-6) and 
calculate p from the inverse of ¢. According to (6-5) and (7-1) the value of p is an approxi- 
mative solution of P(z2a; p) =e, and is consequently an approximation to the lower 
confidence limit p,. With A = —A, and p* = (a+ 1)/(n +1) we obtain the upper confidence 
limit p, by a similar procedure. 

If we take the special value of « obtained by substituting « = a,(A,) given by (6-1) in 
(6-6), we have what has been previously called the best transformation. It follows from the 
results of the preceding section that, in this special case, the term of order (n + 1)—! vanishes 
in (6-6) so that a comparatively simple formula is obtained. 

From a practical point of view, the method outlined above is quite unimportant, as 
(i) excellent tables of confidence limits have been published (Hald, 1952; Mainland, 1948); 
(ii) tables of percentage points of the incomplete beta and F distributions can be used for 
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this purpose (cf. §3). Theoretically the method is, however, of a certain interest, and we 
shall therefore illustrate the dependence of the best transformation upon the prescribed _ 
confidence level by assigning some special values to the normal deviate in (7-1). In the 
series the term of order (n + 1)-1 (‘the skewness correction’) is also given, as it increases the 
applicability of the expansions to cases where this term differs from zero. 

Case (i). A= 1, a,(A) = 0. 

When A is near 1 (¢~ 16 %), it is ‘best’ not to make any transformation at all, and (6-6) 


becomes — ‘ ne 
p=pr-a [(PE) +" ok. Ade oe (7-2) 


3. n+l 
Case (ii). A = 2, a,(A) = 3. 
When ¢ is near 2-5 °%, the inverse sine transformation is best, and the formula (6-6) is 
specialized to 








2arcsin /p = 2aresin /p* —A(n+1)- soem (q* —_p*) (p* q*)* (n+ 1)*+..., 
(7-3) 
or, if the angle $* = ¢( p*) is introduced in the last term, 
$d = p*—A(n+ yt a4 ny 1) cot d* +... 


6 


When 95 %, two-sided confidence intervals are required, it is thus advantageous to use 
the inverse sine transformation. This interesting property of the transformation shows 
that it may serve the double purpose of both stabilizing the variance and furnishing 
approximations to the tail of the binomial distribution. 


Case (iii). An interesting situation arises when A is large. We should then theoretically 
(but not practically!) apply the following transformation: 


D d.: ‘ 
17:9) =|" aaa (7-3') 


Itis interesting to compare (7-2) and (7-3) with the classical methods used in this situation. 
Two classical formulae will be mentioned here. 

If a binomial variable is expanded directly in a C.F. series, and the expansion is solved 
with respect to p, the following equations are obtained (half-correction being used): 


a 9” — Eo — a.,/(F | + eg” tool 


*g* nee (7-4) 
Py = p*+4n+A, (Qh+A : vec 


6n 
with p* = a/n in both formulae. 
A related type of formulae is constructed by solving the equation 


a+}—mp = A, \(npq) (7-5) 
with respect to p (cf. Cramér, 1946, p. 515). 

In Table 1 a numerical comparison is made between (7-2), (7:3) and (7-4) and the formulae 
obtained by solving (7-5). The study is very incomplete, but it gives nevertheless some idea 
of the behaviour of the formulae given in this paper in comparison with those obtained by 
classical methods. The skewness correction has not been included in the calculations, and 
so the formulae have been used in their simplest form. 
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Table 1. Lower confidence limit p, computed from formulae (7-2)-(7-5) 
without skewness correction. n= 49 











Confidence p, computed from 
level a P; (exact) 
(two-sided) (7-2) (7-3) (7-4) - (7-5) 
80% 5 0-050 0-046 0-052 0-036 0-002 
10 0-131 0-128 0-133 0-120 0-132 
15 0-220 0-217 0-221 0-212 0-220 
20 0-312 0-311 0-313 0-308 0-313 
25 0-410 0-409 0-410 0-408 0-410 
95% 5 0-034 0-017 0-033 0-007 0-001 
10 0-102 0-089 0-102 0-081 0-107 
15 0-182 0-173 0-182 0-167 0-187 
20 0-270 0-264 0-270 0-260 0-273 
25 0-363 0-361 0-363 0-360 0-365 
99% 5 0-023 <0 0-019 <0 <0 
10 0-080 0-054 0-077 0-046 0-089 
15 0-152 0-133 0-150 0-126 0-161 
20 0-234 0-222 0-232 0-217 0-241 
25 0-323 0-318 0-322 0-316 0-327 





























The value p, (exact) has been obtained by interpolation in Thompson’s (1941) tables. 

It is seen from the table that the inverse sine formula gives excellent 95% values. This 
confirms the theory developed in the paper. The 80 and 99 % values are also good, better 
than the values obtained by aid of the other formulae. 

The formula obtained by solving (7-5) can be ranked as second. It is, however, remarkably 
inaccurate for a = 5. 

(7-2) is rather inaccurate except in the 80% case, where it is fairly good (in accordance 
with the theory). 

The classical formula (7-4) provides poor values. If it is used, the skewness correction 
(last term in the right member) ought to be included. 

The numerical investigations need to be extended but indicate that: (i) the inverse sine 
method is better than the classical methods for computing confidence limits, if skewness 
corrections are not used; (ii) the expression obtained by solving (7-5) should not be used for 
computational purposes as it is complicated and rather inaccurate. It is better to replace 
(7-5) by the inverse sine formula or, if tables of the inverse sine transformation should not 
be available, by (7-4) with skewness correction. 


8. APPLICATION OF THE BETA-TRANSFORMATION TO THE BINOMIAL TAIL PROBLEM 


We shall continue our study of the beta-transformation by applying it to the tail problem. 
As it is rather obvious how to proceed, we shall only make a few remarks on this question 
without entering upon any discussion of the relative merits of the different formulae. 

The problem consists in determining the normal deviate A which ‘corresponds’ to the 
tail of the binomial distribution. When A has been calculated, we immediately obtain 
P(z2a; p) from (6-5) or P(x <a; p) from (6-12). The determination of A can be made in a 
variety of ways with the tools now at our disposal. 
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First, we have to choose between (6-7) and (6-8). (Formulae which do not contain A in 
the right member may easily be constructed, but we prefer to use the formulae as they stand.) 
We shall only discuss (6-8), as the application of (6-7) is similar. 

We shall assume that only the first term in the right member of (6-8) is computed (if 
higher accuracy is required the computations can be performed in two stages, the second 
term being included in the last stage). Provided that we know something in advance about 
the magnitude of A, the equation (6-4) should, theoretically, govern our choice of a (we 
disregard here altogether the obvious fact that it is more convenient to use one single 
transformation and include a sufficient number of terms of the asymptotic series). If the 
same values are assigned to A as in the last section, we have the following transformations: 


Case (i). A= 1, a,(A) = 1. 
$(p; 1) = log p/q —log po/d. (8-1) 


The transformation series is specialized to a formula which is very similar to the origin 
(4-4) of all our subsequent investigations. Apart from an obvious rearrangement, the two 
expansions differ only in so far as the roles of p and p* are interchanged. Thus we find that 
the logarithmic function which connects the binomial distribution with the z-distribution 
is a prominent member of the class of beta-transformations. 


The logarithmic transformation has previously been used by Dyke & Patterson (1952) 
in an analysis of variance of attributive data. 


Case (ii). A = 2, a(A) = 4. 


Precisely as when the first transformation ceries is used, the inverse sine transformation 
is ‘best’. The first few terms of the expansion (6-8) run in this case as follows: 


A = (2arcsin J/p* — 2 arcsin /p) (n+ 1944 q—p) (pq)-*(m+1)-#+.... (8-2) 


This formula should be compared with a very similar expression which Freeman & Tukey 


1949, 1950) have constructed empirically. In their formula, our quantity —-4—? — 
' wail , ~ ingame Ta + 1) pa} 
is replaced by _ : 

v(np+1) (ng+1) 





Case (iii). A—>0o, a,(A) = 4. 
This leads to the transformation 


dx 
7:8) =|" sai (8:3) 


No numerical comparison of the formulae applicable to the binomial tail problem has 
been included in this paper. The reader is referred to § 7, where the behaviour of (8-2) without 
skewness correction has been studied, and to §9, where the solution of the Poisson tail 
problem has been illustrated by some numerical examples. The results of the numerical 
investigation reported in §7 indicate that the inverse sine method can be recommended for 
practical use, both when confidence limits are required and when the tail of the binomial 
distribution is to be estimated. 
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9. TRANSFORMATIONS OF THE POISSON AND y? DISTRIBUTIONS 
(a) Derivation of Cornish-Fisher expansions for a transformed Poisson variable. 
Determination of the best transformation 


The transformation problem for a Poisson variable can be treated in a similar way to the 
corresponding problem for a binomial variable. For brevity, we shall here only state the 
main results. 

Let the Poisson variable x have the mean m. We put 


P(x 2a; m) = 1— (A). (9-1) 


We introduce a general transformation ¢(x) and derive expressions of the same kind as 
(5-1) and (5-2). The first transformation series is found to be 


p(m) = $(a) —Ag'(a) at + $A?[ag"(a) +.a,(A) o'(a)] + -.., (9-2) 


where «,(A) is given by (6-1). Equating the expression within brackets to zero, replacing 
a,(A) by « and a by m, we have a differential equation which has the solution 


1—a (9-3) 
log m/my (a=1). 


o(m) -|" 2*dz = 


1 
—— m!-*+ const. (a<1), 
™e 


We then find the following series: 


(2—3a) A2—2 


P(m) = $(a) — Aat-* + 3 





a~* — da-t-*[(1 + 6a(a—1))A3+(12a—7)A]+.... 
(9-4) 
(9-3) and (9-4) may be considered as limiting expressions of (6-3) and (6-6). We easily realize 
this by multiplying both members of (6-6) by (n+ 1)!-* and letting tend to infinity. 
Passing to the limit in (6-8), we obtain analogously the second transformation series 


(3a —1)A2—2 
6 


A = [d(a) — d(m)] m4 + m-t — 3,[(12a2— 1) A3— (24a 4+2)A]m-+.... 


(9'5) 


The discussion of the choice of a is made exactly as in the binomial case. The results are 
summarized below. 


(b) Determination of confidence limits for the mean of the Poisson distribution 


From (9-4) we obtain three confidence formulae by giving A the same values as in the 
binomial case, viz. 1, 2 and oo. We then find 


Case (i). A = 1, a,(A) = 0. 
A= 1_ AB-7A 


= a— jai 
m a—dul+—z 36 


fern (9-6) 





Case (ii). A = 2, a,(A) = }. 
2-4 Ae + 2A 


i. ate annie ae 
m! = at —A+—5- at+—5 





a-+.... (9-7) 


Case (iii). A->00, a,(A) = 2. 


A : 
m\ = at [1 Sot jot SMa... (9:8) 
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The series (9-6) is known (Campbell, 1923; Riordan, 1949). The cube-root transformation 
used in (9-8) has previously been suggested by Haldane (1948). It can be considered as 
a limiting case of (7-3’). 

The lower confidence limit m, may be obtained from any of these formulae by substituting 
A = A,, and the upper limit m,, by substituting A = — A, and replacing a by a+ 1. 


(c) Determination of percentage points of the x*-distribution 
The last three formulae can also be used for calculating percentage points of the 
x*-distribution. We then use the well-known relation (cf. (3-2)) 


P(x2a; m) = P(x, < 2m). (9-9) 
Consequently, in view of (9-1), we have 
P(x3, S 2m) = 1— (A). (9-10) 


Let us denote the degrees of freedom of the x?-variable by f. Replacing a by $f, m by 4x? 
and A-by —A in (9-10) and (9-4) we find for a<1 


1 1 (2—3a)A?—2 
—_——- 2)l—a — 1—a + ft—a i ae «il 
yard, fPetaA.2bfre+ a 


l-a@ 
+ 45. 24[(1 + 6a(a — 1)) A3+(12a—7)A}f-*-*+.... (911) 
For « = 0 we have a series given by Peiser (1943) and Goldberg & Levine (1946). The value 
$= gem te At—4 1 A842A1 
6 Jef) 18 yt 


It is of interest to compare this formula with Fisher’s x*-approximation /({2x?) = /(2f—1)+A. 
Finally, for « = $ we obtain after dividing by 3f* and putting c = 2/(9f) 





V(2x2) = J(2f) +A+ 





(9-12) 





(*)'= 1+Ac—e—- ay... (9-13) 
If the last term is neglected we have Wilson & Hilferty’s (1931) x?-approximation. Thus we 
conclude that the results of these authors may be regarded as variations of one single theme. 
The three formulae are all of them accurate, if several terms are computed, but if only the 
two first terms are retained at the calculations, the desired confidence level should determine 
which formula is to be preferred. 

We finally observe that the logarithmic transformation obtained for a = 1 has been 
applied to the x?-distribution by Bartlett & Kendall (1946). 


(d) Determination of the tail of the Poisson distribution 


The area of a tail of the Poisson distribution can, in analogy with the binomial case, be 
calculated either from (9-4) or from (9-5) by assigning special values to a. Similarly, in 
view of (9-9), we can determine by this ineans an approximation to the tail integral of the 
x?-distribution. 

We shall list a few of these formulae in a form suitable for computation. If we omit the 
last terra in (9-8) and solve with respect to A, we have 


A= 3a( -3*)-5. (9-14) 
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If we put « = } in (9-5) we get a similar formula 


a Rs radios 
a= tvm|(¥-) New (9-15) 
The transformation a* used in this equation can be considered as a limiting case of (8-3). 


Table 2. Numerical study of the accuracy of formulae (9-14)—(9-17) 











A computed from 
Mean a A(exact) 
(9-14) (9-15) (9-16) (9-17) 
m=1 1 — 0°34 — 0-33 — 0-33 0-00 — 0-33 
2 0-63 0-64 0-55 0-83 0-55 
3 1-40 1-40 1-29 1-46 1-31 
+ 2-08 2-05 1-95 2-00 2-00 
5 2-68 2-64 2-55 2-47 2-65 
6 3-24 3°17 3-12 2-90 3-27 
7 3°77 3-66 3-66 3-29 3°86 
8 4-27 4:12 4:17 3-66 4-44 
m=10 1 — 3-92 — 3-80 — 3-83 — 4-32 — 3-94 
2 — 3-29 — 3-25 — 3-23 — 3-50 — 3-28 
3 —2-77 — 2-76 — 2-72 — 2-86 — 2-75 
4 —2-31 — 2-31 — 2-27 — 2-32 — 2-29 
5 — 1-89 — 1-89 — 1-86 — 1-85 — 1-87 
10 —0-11 —0-11 -—0-11 0-00 —0-11 
15 1-38 1-38 1:37 1-42 1:37 
16 1-66 1-66 1-64 1-68 1-64 
17 1-93 1-92 1-91 1-92 1-91 
18 2-19 2-19 2-17 2-15 2-18 
20 2-70 2-69 2-68 2-62 2-70 
25 3-90 3-88 3-89 3-68 ' 3-93 
26 4-13 4-11 4-12 3-87 4-16 
27 4-36 4-33 4:36 4:07 4-40 





























In Table 2 a numerical comparison is made between (9-14), (9°15) and the formula 
obtained by taking a = } in (9-5). This formula may be used in two ways: 


(a) A=2Ja—2./m; (9-16) 
(6) A = Ag is computed from (9-16), and the value then obtained is inserted in 





~a.4%-4 1 
A=Agt+ aa (9°17) 


In the table, the.column denoted by A(exact) gives the correct value of A computed by 
means of Molina’s (1947) table from (9-1). Apart from the fact that (9-16) gives poor values 
when A is very different from the value A = 2, all the formulae are remarkably accurate. 
It may be remarked that Freeman & Tukey, in their empirical study of different approxima- 
tion formulae, have used (9-17) in a slightly modified version. 
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10. TRANSFORMATIONS OF THE NEGATIVE BINOMIAL DISTRIBUTION 


The theory which has been developed in the preceding sections can without difficulty be 
extended to the case of a negative binomial variable. Only some results will be briefly 
mentioned here. 

We denote the parameters of the negative binomial variable x by N, P and Q = 1+P. 
The probability that z assumes a given value A is given by 


P(e= A) = [* % 2 ne ‘) P4Q-N-4, 


We introduce the notation P* = A/N. The analogues of (5-1) and (5-2) are of the form 


¥(P) = ¥(P*)+A,N-*+A,N+..., (10-1) 
where the coefficients A, depend upon P*, but not upon P, and 
W(P) = f(P*)+B,N++B,N-1+..., (10-2) 


where the coefficients B, depend upon P, not upon P*. 
The coefficient of N-! in both expansions vanishes, if y(P) is of the form 





P 
WP; ap) =| a (1+2)-Pde, (10:3) 
Po 
Ia (10-1) the parameters a and f should be chosen as follows: 
_ | AMt2 2 A242) é 
“a= 1-9 = 33 (10-4) 
In (10-2) the parameter values are 
_ A®+2 2(A? + 2) 





gr F=1-—ae or 

By assigning special values to A, a variety of different transformations is obtained. We 
shall not enter upon any complete discussion of these questions and only make two short 
remarks. 

(i) If we take A = 2 in (10-5), we find « = }, 8 = 0 and y(P) = 2P+. Thus, when the tail 
of the negative binomial distribution corresponds to a normal deviate equal to about 2, 
a simple square root transformation is ‘best’, not an inverse sinh transformation, which the 
solution of the corresponding problem in the binomial case (cf. § 8) might possibly suggest 
to those led by intuition ! 

(ii) The inverse sinh transformation is not ‘best’ for any value of A in the meaning which 
we have assigned to the term in this paper. It belongs, however, to the class of functions 
(10-3) and is obtained for a = £ = }. 

We finally remark that the formulae which are relevant in the negative binomial case can 
be derived either from first principles by means of the relationship between this distribution 
and the beta-distribution or by translating the formulae obtained in the binomial case in 
an appropriate manner. 


I am indebted to Prof. E. S. Pearson and to the referees for many helpful suggestions. 
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A QUICKLY CONVERGENT EXPANSION FOR CUMULATIVE 
HYPERGEOMETRIC PROBABILITIES, DIRECT AND INVERSE 


By M. E. WISE 


Philips Research Laboratories, N. V. Philips’ Gloeilampenfabrieken, 
Eindhoven, Netherlands 


An expansion is derived for the cumulative probability P, that is, the sum of the first p terms of a 
series of hypergeometric probabilities. If a batch of N has a proportion defective x, P can be seen as 
the probability that less than p defectives will be found in a sample of n. The expansion is in descending 
powers of squares of N —4n+ }, as is the series for the inverse, i.e. P given, x unknown; the first two 
terms of both are obtained. Each is illustrated by a practical example in which several values obtained 
from the first term alone and from the sum of the first two terms are compared with exact values; 
the approximations seem more than sufficient for sampling problems except for probabilities extremely 
near 0 or 1, and are also simple to calculate. 


INTRODUCTION 


In most sampling probability problems we assume, if we can, that the batch sampled is 
infinite. When this is so, the probability distribution of the value or type of the nth unit 
drawn from the batch does not depend upon the values of the previous n—1 units which 
have been taken away. We may want to know the probability that not more than c defectives 
are found in a sample of n when the batch has a proportion x of defective units. Then, if 
the sampled units are not returned to the batch, this probability P is the sum of the first 
c+1 terms of a hypergeometric series. 

No simple way of calculating a hypergeometric series has so far been found. When the 
sample size n is small, calculating and summing individual terms is not laborious (see, for 
example, Finney, 1948, Yates, 1934), but it is so for larger n; the inverse problem, given the 
probability P, to find the corresponding value of z is just as important in practice and looks 
more troublesome still. Any reasonably accurate approximation seems so complex (see, 
for example, Davies, 1933), that the correction for a finite batch size is avoided whenever 
possible. Simpler approximations, for example, those based on a Gaussian distribution, are 
not too accurate as Katz (1953) has pointed out. However, approximations have now been 
found that are both simple and accurate, both for an unknown probability given x and for 
an unknown proportion-defective x given P. The latter expression, surprisingly, is in some 
ways the easier of the two. 

The mathematical treatment is an unusual one in theoretical statistics (though it has no 
doubt been used in statistical mechanics). For this reason it is given in full and also because 
it may be useful in some of the many other mathematical problems involving hypergeometric 
series. For applying the formulae to numerical probability calculations, however, the reader 
needs only to study the last section (8). 


1. MATHEMATICAL EXPRESSION FOR THE PROBABILITY OF OBTAINING LESS THAN Pp 
DEFECTIVES IN A SAMPLE FROM A FINITE BATCH 


This well-known result has to be expressed in a certain mathematical form that is best 
deduced from first principles. To start with, we derive the probability of obtaining exactly 
p black balls (or defectives, say) in our sample of n from a batch containing Nx black balls 
and N(1—2z) white ones. We have, of course, p< Nz. The number of ways of choosing p 
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balls out of Nx numbered balls is the coefficient of #” in (1 + t)**. The rest of the sample con- 
sists of n — p white balls chosen from N(1—z), and the number of ways of choosing them is 
the coefficient of w"-? in (1—u)*-*2, So the number of possible samples of n that contain 
p black balls is the coefficient of #?u-? in 


(1+¢)%*(1+u)¥—A2, (1-1) 
Put ¢ = wv, then Pun? = yPy", (1-2) 
Then the coefficient of wu” in (1+ uv) (1 + w)V—-N2 (1-3) 


is a power series in v, in which the coefficient of v? is the number of ways of obtaining exactly 
p black balls. We want the corresponding probability. The number of possible samples of 
n is obtained by putting v = 1; obviously it is the coefficient of wu” in (1-3), equal to 
N!/{(N —n)!n!}. Dividing by this gives the generating function for the probability P, , of 
obtaining exactly p in a sample of n, as the coefficient of vw, i.e. 


n 
G,,(v) ™ x fag? 
p=0 


and in closed form 


N! 1 d 
car aptvi Gol) — ap |, (1 + woh + pate (1-4 





where the contour of integration 0 goes anti-clockwise round the origin. Let us suppose it 
does not go round u = —1 or u = —1/v. Then (1-4) becomes valid for fractional values of 
Nz, which besides being more satisfying mathematically is particularly useful when dealing 
with the inverse function. So from now on z may take any value between 0 and 1. 


It is worth mentioning some well-known results derivable from (1-4); the hypergeometric distribution 
is only one of many that are most easily handled by their generating functions. First the well-known 
probability P,, , is obtained by simply picking out the coefficient of v?u" in (1-3): 

ni(N —n)!(Nax)!(N—Nz)! 
N! p!(n—p)!(Nx—p)!(N—Na—n+p)! 
(N—n)!(N—Nz)! 
Ni(N—Nz—n)!’ 





Pas (1-5) 





Hence Pro= 


and the sum of the first p terms is 
p-1 a5 
SP, = Pal nNza 2 n(n — 1) Na(N2—1) af (1-6) 





Pin Ii(N—Na—n+1) 2!(N—Na—n+1)(N—Na- —n+at 
which, in the usual mathematical notation, is the sum of the first p terms of 
Py oF{-—n, —Nz, N(1—x)—n+1, 1}, 
as pointed out by Karl Pearson (1934). This sum ought to be called an ‘incomplete hypergeometric 
function’ by analogy with the incomplete beta function. 


Further, regarding r as a variate, its moments, etc., are easily obtained by replacing v by 1 + v in (1-4); 
whence M! 


tiene fs. w(y4 2” 
(N—ayinto +o = mi (tm (14 


in which the coefficients of powers of v in eam +) now give the factorial moments of r; differentiating 
G,(1+¥) with respect to v and then putting v = 0 gives from the residue at u = 0 


(1-7) 


unt’ 





irP, = 7r = nNz/N = nz, (1-8) 
*: — m_ zz — UMN) N2(Nz-1) : 
<Xr(r—1)P, = r?-r NW-1) A (1-9) 
and so on to higher factorial moments. From (1-8) and (1-9) the well-known variance of r is easily found: 
(N—n) 





r?— 72 = na(1—2) 


Nai 














q@Qt8daoss's3 - 














— , —_ 
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2. A CLOSED EXPRESSION FOR THE PROBABILITY OF OBTAINING LESS THAN p BLACK BALLS 


Again the generating function is used. Write 


N! N 1 ‘L+uv\%* du 
(W—n)!n! G,,(v) = (;,) G,,(v) = ami fa +uy" (TE) anti (2-1) 








This suggests putting (1+uv)/(l+u) = 1+z, then when v and u both approach zero, 
z/u->—1, so the z path is the same as the u path. A few lines of algebra lead to 


(*) G,,(v) = (v— aie (1-+2)%#(y—1—2)"-1-V de 
0 


n 2Q7i gntl r 





(2-2) 


The cumulative probability, i.e. the sum of the probabilities of obtaining 0,1, 2,... or 
p—1, is given by 


(7) 2% a (*) sail G,(0) (Stat = +5) dv..., (2:3) 


where O, is a small anti-clockwise path round the origin. Substituting in (2-2) gives 


(") "SP, = (5) | {See (v—1—z)"-% (v—1)9 (uP - 1) az} dv. (2-4) 





r=0 


Let us integrate first with respect to v. Then the path obviously does not enclose the pole 
at v = 1+2z, and the only other pole in the v plane is (the multiple one) at the origin. So the 
factor v-? — 1 can be replaced by v~”. Then the cumulative probability, called simply P 
from now on, is given formally by 





p-l * N es) 1 (1 +2)Nx F(z) dz , 
(,) P= (,)? =~ an) ar a 
1 v—1 \% n-1 ; 
where F(z) = mil (55) (v— 1 —z) yp’ (2 6) 


3. THE MATHEMATICAL FORM FOR THE ‘BEST’ EXPANSION 


The best expansion, the one for which one or two terms give the best approximation, is 
not in powers of N-!, which is what we would expect; had this been so it would probably 
have been discovered long ago. But it was not clear at first even what the form of the 
expansion ought to be.* A guide to what to do is the procedure which succeeded so well 
with the incomplete beta function and its inverse (Wise, 1950) long after it had been.asserted 
many times, that there was no one expansion good enough over all values of the three 
variables, and that the inverse was even more difficult to handle. 

Beginning with F(z) and remembering that N >n—1, since obviously N need not be 
less than 2(n—1), we first transform (v—1)/(v—1—z) into an exponential. To make the 
new path of integration go round the origin, put 


(v—1)/(v—1—z) = e-7/(1 +2). (3-1) 


* After having found it I feel the first term might have been guessed at, but in fact I only reached it 
after several transformations of the contour integrals. 


Biometrika 41 = 
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Then, when v and z tend to zero, 9/(vz) tends to 1. But both the v and the z paths can be 
chosen very close to the origin, and then the 7 path is still nearer zero and is always inside 
the z path. This becomes important later on. 

We find that 


F() =(- | 


Next we convert the exponentials that do not contain an index N into hyperbolic sines, 


2” 
277 





(1+2)"-P-N I om en(h +2) — YP (er 1 | dyn. (3-2) 


ia. wate e1(1 +2) —1 =e (1+2z)t 2sinh d{7 + log (1+2)}. (3-3) 
Substituting in (2-5) leads to 
(") P={(- 1)"/2m} | (1+z)-” F(z) dz/z, (3-4) 
Oz 


where L = N(1—x)—4n+4p+ 3 and 
Fee) = 52, | fexp(dn—N— 3) 1} [2sinh Hy + log (1+2)}}P-*- (sinh 4n)-? ay. (3-5) 


It is now clear that there is a series expansion for P in descending powers of squares of 
M = N—43n+}. So we put 7 = —w/M, and log (1+z) = 6/M. The paths of integration are 
again round the origin, but with | @| >| w| (see equation (3-1) and the paragraph below it). 
We find that 


F(z) = (—1)?/(2miM) [_ e# (2sinh2=”)" "(255 hs) a (3-6) 
1 = ( (270 x ( Sl vd ( sin IM 


(N a (—1)" eh? F(z) dO 
(;) ~ 2miM J 0,2sinh (40/M)’ 
where h = (L—}4)/M = {N(1—2) —4n+ $p}/(N — 4n+}). (3-8) 


The sum of the first n+ 1 terms of the series of hypergeometric probabilities—that is, 


and (3-7) 





the value of P when p = n+ 1—must be exactly 1. This shows that the factor (7) also has 


an expansion in powers of M-*. Further, M = N —4n+} is simply the mean number of 
unsampled units. This is N at first, then one unit is removed and there are N —1 left to 
choose from, then N — 2 and so on down to N—n+1. 

Further, the proportion defective x occurs only in the index —A@, and as n/N tends to 
zero h tends to 1 — x. Thus h looks like an effective proportion of ‘good’ units, and we shall 
see later that this is just what it is. 

So far the calculations are not laborious, but rather tricky, so that we have given inter- 
mediate steps. It only remains to expand the function and its inverse. This is straight- 
forward; there is perhaps a shorter way of obtaining the inverse. 


4, THE FIRST TWO TERMS OF THE EXPANSION FOR THE PROBABILITY 
It is easily found that 
{2sinh (4ec/M)}” = (w/M)? {1 + pw?/(24M2) — ...}, (4:1) 
and from this and similar expansions 
M-» (*) P = ( _— 1)"+P eh0+w (0 *.. u')P—n—1 
n An? 00d Ow Ow? 


_(n—p+2) (0—w)? + 2w(O —w) + (p+ 1) w*) : 
x {1 ian |dwodd, (#2) 








Se 
+ 




















= we oT 





er- 
ht- 


t-1) 


4-2) 


—— >, 


ee, 
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with |@|>|w|. So the first approximation is the double contour integral on the left. 
We write it as ” Elena e-h6+w dwd6 

(2771)? J 05) 0, 0 — wy we 
Then each of the three terms in the coefficient of M-? is a similar H integral. 
Now introducing the expansion of the left-hand side (of course it can be found as a special 


case of the one on the right, but was obtained more easily from simpler contour integrals 
like those given in § 2), this is* 





H,(n—p+1,p) = dwd0. (4-3) 








-n(N\ _ 1 f,_ (1 n(n+1) = ; 
M (1) = ai {t- SA) + coctfcient of ar |, (4-4) 
whence 
P p— =) a(n + 1) 
n\ 24M? 
+term in M-4, (4:5) 


and it only remains to find the H, integral. By putting 0 = w+t and integrating once, the 
resulting integral was recognized as an incomplete beta function, which was to be hoped 
for, for if M—co but n stays constant, we should obtain a sum of binomial probabilities in 
the limit. This would prove that H is an incomplete beta function, but it is a useful check to 
verify this eee 7 differentiating with respect to h: 


tle e-h6+w dw dO 
os ~ (2m)? I,J (0 —w)"PH ye (|| >|). (4-6) 


Put 6 = w+t; the path in the ¢ plane must go round ¢ = 0. Then 








-.t~a ~ ew-—Mdwdt (—1)" I eM (1—h)P-tdt — hn-?(1—h)P- (4-7) 
Hh me JoJo, wir ~ mi Jo, *@PA(p—1y! ~ (n—p)!(p—Il 
Now by definition the incomplete beta function 
A 
h(n—p+ 1p) = nt [ 91 —1>-4dtf{(n—p)! (P= 1)}, 
0 
therefore H,(n-—p+1,p) = = I,(n-—p +1, p)+ constant. (4-8) 


To find the constant put / = 1 or 0. To find H,(n — p+ 1, p) the path of integration in the 
6 plane is split into two parts, one going (only) round @ = 0 and the other round 6 = w. 
Integrating first with respect to 0, the first path gives e’w!-" and the second —e”w!-”, 
Therefore H,(n—p+1,p) = 0. Similarly, it can be verified that H,(n—p+1,p) = 1/n!. 
_ H,(n—p+1,p) = h(n—p+1,p)/nl. (4-9) 
Using (4-9) and (4-4) the first two terms of the expansion of the cumulative probability are 
found to be 
mn {(n+1) hin—p+ 1,p)—(n—p +2) in—p— 1p) 
—(p+1)]h(n—pt+1,p—2)+2h(n—p,p—1)}, (4:10) 


P=1,(n—p+1,p)+ 


N 
* This expansion for (*) is the subject of a separate note (Wise, 1954). 


21-2 
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in which form it is very easy to work out numerically on a machine, whenever we can choose 
values of h, n and p for which the incomplete beta functions have been tabulated (Pearson, 
1934). The first term is the sum of the first p coefficients in the binomial series {h + (1 —h) t}" 
of powers of ¢ up to ¢?-1. It looks as if the M~* term diverges for larger n, and of course the 
first positive term and the two negative ones do so, but they tend to cancel one another. This 
is more obvious in the expansion for the inverse. However, another form of (4-10) is inter- 
esting. By working out the contour integrals in a different way, or by using recurrence 
relations connecting neighbouring values of the incomplete beta function,* we find that 


n\ hn-P-1(] — h)P-? 
24M2(n—p)!(p—1)! 
where e(h,n,p) = (n—p)(p—1)A(1—h) (2h—1) 

—(1—A?) (1—h) {((n—p+1)?—1}+(p?—1) (2h? A). (4-12) 





P=1,(n—p+1,p)+ e(h,n, p), (4-11) 


Note that if p is replaced by n—p+1 and h by 1—h, ¢ changes to —e, whilst its coefficient 
in (4-11) does not change. Further, J,(n—p+ 1, p) then becomes 


L-»(p.n—p+1)=1-1,(n—p+l1,p). 


So P becomes 1—P exactly. But if h changes to 1—h and p to n—p+1, x becomes 1 —z, 
simply from the definition of h as in (3-8). This is easy to interpret, for if there are less than 
p black balls in the sample of n, with probability P, there are then at least n —p+1 white 
ones, and 1 — P is the probability that there are less than n — p + 1 white ones. This property 
of anti-symmetry is exactly satisfied by (4-11) and (4-12). 


5. EXPANSION FOR THE INVERSE 
Given the probability P of finding less than p black balls in the sample of n, we wish to find 
the corresponding batch-proportion x. This occurs only in A = {N(1—2x)—4n+4p}/M, 
where M = N —}n+ 4, and clearly the first approximation h, to h will be given by 


I,(~—p+1,p) = P. (5:1) 
It is clear too from (4-2) that we can write 
h =h,+6/(24M?) +O(M-). (5-2) 


Substituting (5-2) in (4-2), and Legh. the M-* terms, which do not affect 6, 


He ce | (n an, eh 99+ (w— 6)p—n-1 
Ene (x3) ‘a oe 3 MI. th Ow? 


(n—p+1)(0—w)? + pw? + 6 
24M? 








x{1- | dwao 


é 
- rip aaa |, |p. M me -O-*w-? doa, 


Hence 





1 \2 e—hoI-+w 
_ (=) I, 0, 0w?(0 — w)*-PHi [n* --n —{(n—p +1) (0—w)? + pw* + 67} — 08] dwd8. (5-3) 


* The coefficient of n(n—1)/24M? in (4-10) is expressed as the sum of three differences between 
incomplete beta functions, and these have coefficients n— 1, 2 and p+ 1 respectively. 























—_—.——— > 
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|@|> || as before. Let us then consider the 6 integration first. Its path goes round two 
poles, at @ = 0 and 0 = w. So we replace this path by two paths, one round @ = 0 only and 
the other round @ = w only. We call the two new integrals f, and f, respectively. For the 
first one we have |@|<|w]|. Integrating round 6 = 0, 





2 w {3 _ 9» — we w 
(5-4) 


Then expanding the exponent, the two terms from the residues at the origin are equal to 
+(—1)"-?+1(n+1)/(n—2)! respectively. Thus f, = 0 and we are left with the integral 
round 6 = w, and now we have | @—w|<|w|. Write equation (5-3) as 





1 \2 —hy I+ 
f=0= (=) J Cod Ow Tat Oy wA Od, (5°5) 
where © = {n§-—n—w*(n + 1)} + {2w(n—p+ 1)-—d}0-—A(n—p+ 2). 


C, goes anti-clockwise round 6 = w. Write (5-5) as 


0=f,=fst+fatts- 


f, corresponds to the coefficient of 6 in ‘@’ and is a multiple of the first derivative of an in- 
complete beta function with respect to h (see (4-6)) at h = hy; f, is a multiple of the second 
derivative. To evaluate f, put 0 = w(1+s). Then the s path of integration goes round the 
origin but not round s = — 1. We get 





1 \? et(1—ha—hig 8) . ” sadaie ot 
fa= (sn) J J o, (1 +8) w®tign—Pt1 {n?—n—w*(n + 1)}dsdw. (5-6) 
Integrating first with respect to w we need only the residue at the origin. This gives 


oe (n+1)ho (1 —hp — hg 8)"—* (hy — 2+ hogs) ds 
8 (n—2)! 27 J o, spt : 





Again from the residue at the origin, dropping the suffix 0 in h, from now on, 
f= (DP mty) 

* (np)! (p—1)! 

Now to evaluate f, and f, we use (4-6) and (4-7) and find that 





(1—h)P-*hm-P+{(h — 2) (p—1)—(1—h) (n—p)}. (5-7) 








aye pf 2(m—p+1)h-P(1— Ayr? h-P(1 —hyPt , 
fom (oe eat ape) 7 
fy = (— 1-9 BaP DP in—p)(1—W)—(p—1)h}. (59) 


(n—p)!(p—1)! 


The equation determining @ is f,+f,+/, = 0. After some simplification it appears that 
the best expression for é is 


6 = d(h,n,p) = (;-) (n—p+ 18+ (1-2-5) 2* 


+(1= 2h) {(n—)(p—1)- I} + -5- (5°10) 
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Recapitulating, when h = {N(1—2x)—4n+}p}/M, M = N—4n+}, and z is such that 


p-1 
> P,,, = P exactly, 


r=0 
h = ho +8(ho,n, p)/(24M?) +O(M-), (5-11) 
where [,,(~—p+1,p) =P. 


Note that the anti-symmetry property is again exact, for 
d(1—h,n,n—p+1) = —d(h,n, p). (5+12) 


In the next section we derive a simpler expression for 6. 


6. A SIMPLE APPROXIMATION TO THE SECOND TERM IN THE 
EXPANSION FOR THE INVERSE FUNCTION 


The expression for 6 can be surprisingly simplified for one of the most important practical 
applications. We have only to use an expansion for hy, defined in (5-11) as an inverse in- 
complete beta function, in terms of percentage points of the y* distribution (or of the Poisson 
distribution). We require the value of y, = $x3,,(P), that is, half the value of x* with 2p 
degrees of freedom and a probability P of being exceeded. The expansion is (Wise, 1950) 





_  -Yof, , (P—1)(p+1+Yo) (2)" ; 
ing io ar (1 5 24m? +? m) }’ ce) 
where m = n—4p+#, or the mean of n,n —1, ....n—p+1. Now in most practical sampling 


problems the batches have small proportions of defective units, and then, for all non- 
extreme probabilities P, y), which is of the same order of magnitude as p (see (6-4) below) 
is considerably smaller than n and m. So an expansion of 6 in powers of m— should give a 
good approximation to 6. This was even better than expected, for it began with a term in 
m/Yyo, and the next term was the coefficient of m—!; there was no constant term. (I could not 
find any underlying reason why this is so.) As far as m~! we find that 





Bho, P) = (Yo—P+1) (2ye++1)—2m +00, (6-2) 
0 

“na ais _ —j])2 
Whees 3, = % Pots 7p+7)_4_ Yo P ca mend - . (6-3) 


For many probabilities the y, values can be read directly from tables (Catherine Thompson 
1941; Hald & Sinkbaek, 1950), so this formula is very easy to use. We can also see what 
happens to é for large values of n, p, etc., although only very roughly. Campbell’s (1923) 
expansion gives 


_ 1 re _ >= ® 
Yo = P+Ep/p+F(Ep—1)+O(p+), where Jon),,° dt = P, (6-4) 


and this gives d~ a7 Eppt, 8_,~ —2Eppi, (6-5) 
0 
so that the d_, term is only of the order of — y?/(8m*) times the leading term. More fully 
dyo/m = 3Epp! + 3Ehp +f pt (46% — 36 p) + }( 26% — &} + 8) (6-5) 
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So for a given n, d increases with £, and hence with 1~P. In fact at the 50% point ¢ is 
very close to zero. 

The correction term 6/(24M?) is largest, for a given P, N and p, when n = 4N—for n>4N 
we can work with the unsampled units (see §8(b)). When n = 4N, M+3n and the term 
correcting hy is 6/(54n*); asymptotically 

8 _(n—4p+d)Eppt 

54n? 18n? : 
which tends to zero, although slowly, if p/n stays constant and both p and n tend to infinity. 
But the factor j, ensures that the correction term is always small. 





(6-6) 


7. Discussion 


The accuracy of the sums of the first two terms of the expansions seems good enough for 
almost all practical purposes, as is shown by the numerical calculations in the next section; 
it is also sufficient for providing mathematical expressions in other problems where hyper- 
geometric probabilities are needed. One term is enough when the sample size is rather 
smaller than 0-4 of the batch size (as in the example given here), or when both sample and 
batch are very large. The error in neglecting all other terms can then be estimated from 
(6-2) and (6-5). For extreme probabilities the inverse expansion is rather less accurate and 
for very extreme ones both expansions may break down. For we can write 


1—h = {Nx—}(p—1)}/(N —4n+}). (7-1) 

Nz is the number of defectives in the batch, and if Nx < p — 1 there can never be more than 
p—1 defectives observed, i.e. P = 1, whilst 1 —h is not necessarily 1 (as it should be then) 
and can even be negative! Fortunately, these probabilities are seldom wanted and they 
often correspond to very few terms of the hypergeometric series and can be calculated or 
approximated to in another way. 

We mentioned that in the formula for the direct probability, 1 —/ is in effect a proportion 
defective in a binomial sample of 7, i.e. a sample from an infinite population. Let us write 
it as 2. It is of interest that x, can exactly equal the real proportion defective z, namely, 
if x = (p—1)/(n—1) (when p—1 is nearly equal to the mean number of sampled defectives 
nx). This is perhaps clearer from the expansion for unknown z; we can rewrite (5-11) as 

d(1—2,n,p) \/, nm—1\. p-l 
=|*— gaar= yet pe (Ia) aa site 
which gives a direct comparison between corresponding percentage points in binomial 
and hypergeometric distributions. The term containing @ is relatively small unless the 
sample size n is well over half the batch size N*. 

It is surprising that such accurate but simple formulae should not have been found 
before; this may be because it is so often assumed that probabilities in a complex distribu- 
tion function can only be simplified and calculated by fitting a simpler distribution function 
to it. Clearly this is not always true. A mathematical treatment with generating functions 
of two variables and double contour integrals seems novel in probability theory, but this 
type of expansion is well-known in statistical mechanics as a Borel or a Laplacian expansion. 


* Hence we can nearly always use the simplest approximation to 6, negiecting é_, in (6-2). d should 
then, strictly, be written 4(P, n, p). 
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8. NUMERICAL EXAMPLES 


We shall give examples of the numerical calculation of the probability and of its inverse, 
and afterwards compare them with some exact values. In each case we shall calculate the 
whole of an ‘operating characteristic’. This is defined as follows. Let a batch of N units be 
accepted if less than p defectives are observed in a sample of n from the batch. Let Nz be 
the number of defectives in a batch; then the probability P of accepting the batch decreases 
as x increases and the P,x curve is the operating characteristic; the P values are sums of 
the first p terms of a hypergeometric series (as in (1-6)). Obviously P can be calculated for 
given values of z or x as a function of P; in both cases it is convenient to suppose that Nx 
can take all values between 0 and N. 


(a) Example with unknown probabilities 
We shall calculate the probability of accepting a batch of N = 200, sample size n = 80, 
with p = 33.* This (see (4-10)) is obtained from 


P= "5 Par = a(n pt+1,p)+——, (8-1) 


where M =N-4n+4, h={N(1—2z)—4n+}p}/N, 


= (n+1)L(n—p+1,p)—(n—p+2)i,(n—p—1,p) 
—(p+1)L(n—p+1,p—2)+2h(n—p,p—1), 


and I,(n —p + 1, p) is the incomplete beta function, which here gives the binomial probability 
of observing less than p defectives in a sample of n from a population with proportion- 
defective equal to 1 —h. 

The obvious thing to do is to calculate P for a whole series of values of 1—h, and I have 
done this for the sixteen equally spaced values 1 —h = 0-46 (0-02) 0-76. All the incomplete 
beta functions required can be read directly from Pearson’s (1934) tables; further, the 
correction term J, is so quickly obtained using a calculating machine that only the first 
incomplete beta function needs to be written down. For the example chosen with 


N =200, n=80, p=33, M = 160-5, 


we have 
"SP., = I,(48, 33) + saan {811,(48, 33) — 491, (46, 33) — 34], (48, 31) + 21,(47, 32)}. 
0 (160-5) 
The effective numbers of defectives are given by a 
2002 = 176-5 — 160-5h. (8-3) 


Corresponding to these, the probabilities of acceptance are set out in Table 1. 


* This is by no means unrealistic, although 32 defectives out of 80 would be a very high proportion. 
But it is sometimes advantageous to test units by a gauge with closer limits than the tolerance limits 
prescribed for the units themselves; for example, v.d. Weiden (1953) has convincingly demonstrated 
how efficiency is thereby improved in many attribute sampling systems for inspection and quality control 
of batches. 
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(b) Numerical accuracy of example under (a) 


By interpolating in Table 1 as accurately as possible (to do this the probabilities were 
first transformed to probits), I obtained the probabilities P, given in Table 2; under these 
are set out the corresponding exact values of P (v. Heezwijk, v.d. Linden & v. Strik, 1947). 


327 


Table 1. Numerical values of probabilities calculated from one and from two terms of (8-2), 
as a continuous function of the proportion defective x (N = 200, n= 80, p=33) 









































200z 54-52 57-73 60-94 64-15 67-36 70-57 73-78 76-99 
P (1st term only) | 0-99951 | 0-99789 | 0-99264 | 0-97886 | 0-94879 | 0-89343 | 0-80634 | 0-68808 
P (1st two terms) | -99975 | -99863 | -99449 | -98254| -95471 | -90109| -81410/| -69365 
200z (cont.) 80-20 83-41 86-62 89-83 93-04 96-25 99-46 102-67 
P (1st, term only) | 0-54837 | 0-40392 | 0-27264 | 0-16745 | 0-09300 | 0-04646 | 0-02075 0-00824 
P (1st two terms) | -54989 | -40095 | -26636 | -15992| -08613 | -04133 -01752| -00651 





Table 2. Comparison of probabilities P, obtained by interpolation 
in Table 1 ( first two terms of expansion) with exact values 











2002 100 90 80 70 60 
P, 0-01677 0-15518 0-55922 0-91289 0-99623 
P (exact) -01504 -15494 -55929 -91308 -99614 


























(c) Calculating the probabilities when the sample size is more than half the batch size 


If more than half the units in the batch are sampled it is more accurate (although less 
convenient) to calculate the corresponding accumulated probabilities for the unsampled 
units. If the sample number is now n’ ( > $V) and P’ is the probability that p’ — 1 defectives 
or less are found when there are Nz’ defectives in the batch, elementary reasoning like 
that at the end of § 4 shows that formula (8-1) is still applicable, but with 


z=l-2', P=P’. 
h = (p'+Ne')|(N+n' +1). 


Obviously this result breaks down if Nz’ <p’ or p<0, but then the corresponding pro- 
babilities are respectively 1 and 0. 


n=N-n’, p=N(l—2z)-n'+ 7’, 


Hence M=}(N+n'+1), n-—p+1=WNz2'-y’, 


(d) Calculation when the incomplete beta values are not tabulated 


Outside the range of Pearson’s tables calculating the probabilities is less simple and the 
inverse function is generally easier to find. If we do need the direct probabilities, it is best 
to use formulae like the following (Wise, 1950): 

; OE 
L(n-—p+1,p) = el +y+ ry +...+ (p= aH 








e- ( p? — p) f yPtt 
24m*  \pl* (pelt? 
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where m = n—}p+}4, y = —mlog,h. The first term is a cumulative sum of Poisson pro- 
babilities and the second term the difference between two such sums; both can be obtained 
(usually with at most one-dimensional interpolation) from Molina’s (1945) tables or those 
of Pearson & Hartley (1954, Table 7). 


(e) Calculation of the inverse function 


We take the same batch size N and sample size n, but p equal to 7 instead of 33, and seek 
the proportion-defective x such that the probability of observing less than p defectives in 
the sample of n is P. In general terms, that is, irrespective of whether Nz is a whole number 
or not, we ask what is the value of x such that the corresponding sum of the first p hyper- 
geometric probabilities has a ratio P to the sum of all of them (n +1 of them)? Obviously 
the first approximation x = 2, is given by 


I,,(n—p+ 1, p) = P, (8-4) 
where Na = (N—4n+})(1—h)-—}(p-D), (8-5) 


and x = 2 when h = hy (see also (7-2)). The second approximation, allowing for the M~* 
term, where again M = N —3n+4, is 


h = h,+6/(24M2). (8-6) 
Table 3. Values of equivalent numbers of defectives for given probabilities; N = 200, n= 80, 


p=. 2002, calculated from first term of (8-6), 200x, from first two terms, 200x by inter- 
polation from exact probabilities 






































Pi 0-995 0-990 0-975 0-950 0-900 0-750 0-500 
20029 7-196 7-791 8-768 9-712 10-925 13-264 16-334 
2002, 7-544 8-222 9-117 9-990 11-134 13-367 16-330 
200z _ 8-24 9-145 9-993 11-138 13-366 16-318 

‘ats 0-250 0-100 6-050 0-025 0-010 0-005 
2002, 19-904 23-542 25-907 28-068 30-703 32-571 
2002, 19-796 23-332 25-634 27-733 30-306 32-097 
200z 19-784 23-323 25-622 | — _ —~ 























For 6, see equation (5-10); however, in this particular case é can be simplified (see § 6 and, in 
particular, (6-2) for full details) to 





d= mor RAD Eto Pe”) _ al 


8-7 
Yo i 


where m = n—4p+4, Yo = 4x3,(P). 
Again x will be calculated for a whole range of probabilities; we therefore require values 
of hy such that 
I,,(74, 7) = P. 
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These were obtained (see equation (6-1)) from the close approximation 


- 6(8 
hy = exp | 014 te |: (8-8) 


Here the values of 2y) are x? values with 2p = 14 degrees of freedom and a probability 
P of being exceeded. These were read off from Catherine Thompson’s tables (1941) for all 
the probabilities given there. The resulting first and second approximations are x, and x, 
and the corresponding effective numbers of defectives, i.e. 200 times these, are given in 
Table 3. The last row of the table shows, as 200, some exact values obtained by inverse 
interpolation from the exact probabilities calculated by v. Heezwijk et al. (1947); these 
again were first transformed to probits and differences up to the fourth allowed for. 

We see that the first approximation is appreciably different from the second one except 
near P = 3; of course this difference decreases rapidly with the ratio (n/N) of sample size 
to batch size. 
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THE QUOTIENT OF A RECTANGULAR OR TRIANGULAR 
AND A GENERAL VARIATE 


By S. R. BROADBENT 
British Coal Utilisation Research Association 


1. INTRODUCTION 


It is common to take measurements of two quantities in order to determine their ratio. 
For instance, the input and output of work determine the efficiency of an engine; the time 
taken to traverse a distance measures velocity; and the residue of a weight of reactant in 
a chemical process gives the proportion which has reacted. Efficiency, velocity, proportion 
and indices in biometry are examples of quantities which are necessarily ratios. When the 
two measurements made are subject to error, their quotient is distributed about its 
expected value. 

There are cases in which experience, a priori considerations, or repeated trials give the 
distributions of error of the numerator and denominator separately. It may, however, be 
impossible or undesirable for reasons of economy to repeat the experiment in which the 
two quantities are measured simultaneously. The precision of a single trial must be found 
by theoretical arguments. Two examples will demonstrate this. The acceptance trial of an 
industrial boiler is a lengthy and expensive process which results in a figure for efficiency. 
It is necessary, from this one experiment, to state confidence limits to the true value of the 
efficiency. Secondly, the reading of a flow-meter in a pipeline may depend on the ratio of 
two quantities, whose dimensions have been manufactured within certain tolerances. It 
is required to state, without the great number of experiments needed to calibrate a sample 
of these meters, the tolerance of the reading of a typical meter. 

It may be the fiducial distribution of the quotient that is required, or the frequency 
distribution; for the types discussed the two are formally identical. Those limits which are 
obtained by taking the extreme possible values of numerator and denominator are un- 
necessarily wide. Approximate methods, such as the assumption of the normality of the 
quotient, may suffice for some purposes, but these methods should when possible be com- 
pared with the exact results, which it is clearly desirable to have. 

It often happens that errors of measurements are distributed in one of two ways: in 
rectangular distributions or in normal (Gaussian) distributions. Instrumental error is often 
rectangular; length, time and weight are usually recorded ‘plus or minus X ’, it being under- 
stood that the true value is equally likely to lie anywhere between these limits. It may be 
noted that replication is often pointless in these cases; the instrument is incapable of 
recording with greater precision and repeated readings will give identical results. A measure- 
ment which has been made precisely and is then rounded off is also subject to rectangular 
error. Sampling error, and the sum or mean of a number of errors, may often be taken as 
normal. 

A measurement is sometimes the difference of two readings, each of which is liable to 
independent errors from the same distribution. The increase in weight during a certain 
process, and the measurement of a length (or other quantity) by recording the distances of 
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its ends from an arbitrary zero, are examples of this type of measurement. The difference 
of two rectangular variates with the same range is a triangular variate; the difference of 
two normal variates is itself normally distributed. 

There are therefore three common distributions of error of measurement: rectangular, 
triangular and normal. These three types of error define six distinct distributions of quotient, 
the order in which a pair of types is chosen being immaterial, since the distribution of the 
reciprocal of a quotient is determined by that of the quotient. The six distributions may be 
represented, in an obvious notation, by R/R, R/T, T/T, R/N, 7/N and N/N. The first three 
distributions are not difficult to obtain; the distribution N/N has been discussed by Geary 
(1930), Fieller (1932), Nicholson (1941) and Creasy (1954). The remaining distributioas, 
R|N and T'/N, form the subject of the present paper. 

These distributions may also be used for testing two variates, rectangular, triangular, 
or normal, said to have the same mean or to have means in a given ratio. 

The quotients R/N and T/N have frequency and distribution functions which can be 
got by straightforward integration. The expressions obtained are difficult to manipulate 
and awkward for numerical work. The method described below obtains the distributions 
in these and more general cases in a form which makes numerical work possible. In par- 
ticular, existing tables assist the calculation of percentage points of the distribution. 


2. THE QUOTIENT OF A RECTANGULAR AND A GENERAL VARIATE 


We require the distribution function of q’ = (a+6y)/(u+o€), where 7 is rectangularly 
distributed in (— 1, 1) and is independent of 7 with mean zero and variance 1. We suppose 
a>0, bla =a, 0<a<1, w>0, o/u = £, 0<f<oo. The distribution of £ is also subject to 
the restriction given below. Since q’ = (a/u)(1+a)/(1+£&), we consider the standardized 
quotient g = yq’/a = y/x, where y is rectangularly distributed in (l—a,1+a) and x has 
mean 1 and variance f?. If x has the distribution function F(x), we suppose the frequency 
function (d/dx) F(x) = f(x) exists almost everywhere, and that F(z) = z has inverse x = G(z) 
defined, non-zero, and finite for almost all z. This condition precludes mass points at x = 0 
and x = ©; it is satisfied by all the usual distribution functions. Let F(0) = €; we do not 
at present suppose € small. 

Now z is independent of y; z is distributed rectangularly in (0, 1). The joint distribution 
of z and y is dzdy/(2a). For each z, dy = | G(z) | dg, and q has the range 


((l—a)/G(z), (l+a)/G(z)) if z>e, 

((1+a)/G(z), (l—a)/G(z)) if z<e. 
Therefore z and q have the joint distribution | G(z) | dzdq/(2x) over the regions shown in 
Fig. 1. 

Pr(0<q<Q,)(Q,>0) is given by the integral of this element over the region bounded 
by q = Q,, 2 = land q = (1—«a)/G@(z) minus the integral over the region bounded by g = Q,, 
z= 1 and g = (1+«a)/G(z). When we have integrated the repeated integral with respect 
to q the first integral is 1 
2a | 2=F{(1—a)/Q,) 
Changing the variable to £, and writing 


9(5) = Af(.+ £6), 


{Q, G(z) —(1—«)} dz. 
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the frequency function of the standardized form of x, and 


. slyts X = (l—a—Q,)/(£Q,), 
we write this integral 


Be [> 6x ate ae, 


Writing J,9(X) = | ”  €—X)g(é) dé, 
g=X 
and Y = (1+a-—Q,)/(AQ;), 
q q = (1-—a)/G(z) 
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q= (1 —a)/G(z) 





9 =(1+a)/G(z) 
Fig. 1 


and remembering that. Pr(qg <0) = Pr(x<0)+Pr(z=0o) = ¢, we see that the cumulative 
function of g is, for Q, > 0, 


Pr(q<@Q,) = 6+ 4J,9(X)—Sh(¥)} (1 
It follows from (1) that 
Pr(g>Q,) = Sy +9 ¥)]-[X +01X)]}-e. (2) 


These forms are particularly useful when ¢ is small or zero for the calculation of per- 
centage points at the tails of the distribution of g. For as Q, > 0 and X, Y +00, both J,g(X) 
and J,g(Y)—0, the former more slowly than the latter. For small Q,, i.e. at lower per- 
centage points, J,g(Y) is small in comparison with J,g(X) for many distributions (in par- 
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ticular when z is normal). In these cases, by successive approximation in X, lower per- 
centage points may be calculated from (1) when a table of J, g(X) exists. Similarly, for large 
Q,, i.e. at upper percentage points, X +J,g(X) is small in comparison with Y +J,g9(Y) for 
many distributions. From (2) upper percentage points of g may therefore be calculated. 
The percentage points of q’ are (a/) times those of q. 

When ¢ is not small, we may consider Pr (¢ < Q,) (Q, < 0). The integrals over the regions 
bounded by ¢g=Q., z=e, q = (1+a)/G(z) and g=Q,, z=e, q = (1—a)/G(z) may be 
expressed in the same way as 


Pr (q<@,) = = Seller &- Yate ag-["" E-Xyateaeh, 
where = (1+a—-Q,)/(2Q2), X = (1—«—Q,)/(AQz). 


3. THE QUOTIENT OF A TRIANGULAR AND A GENERAL VARIATE 


The sum (or difference) of two independent rectangular distributions of the same half- 
range 6 is triangularly distributed. If the sum (or difference) of their means is a, we con- 
sider the distribution of a +67, where 7 is distributed triangularly in (— 2,2). We require 
the distribution of g’ = (a+6y)/(u+o€). We suppose a>0, bla=a, 0<2a<1, w>0, 
alu = B, 0<£<co. We suppose also that £ is independent of 7 and satisfies the conditions 
of §2. We consider the standardized quotient g = y~q’/a = y/x. Here y has the frequency 


element (y—1+2a)/(402), (1—2a0<y<]1), 


(1+ 2a—y)/(4a?), (l<y<1+2za). 
The joint distribution of z = F(x) and q is 
G(z) {@G(z) — 1+ 2a}dzdq/(4a?), ((1—2«)/G(z)<q< 1/G(z)), 
G(z) {1 + 20 —qG@(z)}dzdq/(4a*), (1/G(z) <q < (1+ 2«)/G(z)), 
when z>e, and corresponding expressions when z < e, over the regions shown in Fig. 2. 
Pr (0<q<Q,) (Q,> 0) is the integral of the first element over the region bounded by 
q = Q,,z = land q = (1 — 2a)/G(z), minus the integral of the difference of the two elements 
over the region bounded by g = Q;, z = 1 and q = 1/G(z), minus the integral of the second 
element over the region bounded by g = Q,, z = 1 and g = (1+ 2a)/G(z). 
The first of these integrals is 
ia) 
402? J = F{(1-22)/211 
When we change the variable to £ and write 


U = (1—2a-Q,)/(8Q,), 


PQh 
aril. (E—U)®g(E) aE. 


4{Q2[G(z)]? — 2Q, G(z) (1 — 2a) + (1 — 2x)"} dz. 
the integral becomes 


Writing JygD) = 5] EUG, 
= (1—Q,)/(2Q,) and W =(1+2«e—Q,)/(2Q;), 


we obtain the full expression 


Pr (q¢<Q) = ce 5 0(0 )— 2U,.9(V) + J.g(W)}. (3) 
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It follows from (3) that 


Pr(q>Q) = BSF s910)] -2] $4 -a01)| +[ 7-0] -« 











(4) 
The forms (3) and (4) have the advantages in calculation noted for (1) and (2) respectively. 
When ¢ is not small Pr (¢g < Q,) (Q, < 0) may be obtained as before. 


q q=(1- 2a)/G(z) 








q = (1—2a)/G(z) 
q= 1/G(z) 
q = (1+ 2a)/G(z) 


Fig. 2 





4. THE GENERAL THEOREM 
The results given for one rectangular variate and for the sum of two independent rectangular 
variates of the same range can be generalized for the sum of n independent rectangular 


variates of the same range, when the resultant distribution is that given by Irwin (1927) 
and Hall (1927). 


Let y have the Irwin-Hall distribution, i.e. 
Y=Y,+...+y, (n=1,2,...), 
where each y; (i = 1,...,) is a rectangular variate independent of y,,...,y;-, and with 


range (a,—6b,a;+6). Let > a,=a>0, bla =a, 0<na<1. Let x be independent of y and 
i=1 


have the distribution function F(x) such that (i) z has mean 4 > 0 and variance 0°, o/u = £, 
0<f<0oo, (ii) the frequency function (d/dx) F(x) = f(x) exists almost everywhere, and 
(iii) F(z) = z has inverse 2 = G(z) defined, non-zero, and finite for almost all z. Let F(0) =e 
and Q>0. 





(4) 
rely. 
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Then if g = y/x, Pr(q<aQ/z) is 


e+ (FE) (%aatXe)— (7) 9(%)+ (5) aX). 


the series terminating at the (n+ 1)th term, where 


Tg(X) =)” EX) oe as, 


9(£) = Af(1+ £8), 
and X, = (1l—(n—2r)a—Q)/(BQ) (r = 0,1,...,n). 


5. THE Functions J, 9(X) 
J,,9(X) is the Riemann-Liouville integral of the nth order; it may also be written 


[rode PP oer dea db, ab. 

En=XJ En-1=En &=8 

From this form it is clear that lim J,,g(X) = 0, and that (d/dX) J,,9(X) = —J,_,9(X). This 
xXx->o@ 


relation between the derivate and the integral of lower order may be used for interpolation 
in tables of J,,9(X). 
It is easy to show that X + J,9(X) -| (€+ X)g(—£&) dé. It follows that 
=-X 
(i) lim [X+J,9(X)] = 0, and 
X—>-o© 

(ii) if g(£) is symmetrical about € = 0, i.e. if f(x) is symmetrical about x = 1, then 

X+J,9(X) = J,g(—X). Similarly, it may be shown that 
ae X*+1 
@) tim [FF -nm] =o, 


x—-© 





2 
(ii) if f(z) is symmetrical about z = 1, then = ms i. 29(X) = J,g(—X). and 








cit) (Sp) [G90] = x + 012. 


The pairs of forms, (1) and (2), (3) and (4), therefore have symmetrical properties. 

When z is distributed normally, J,,g(X) = Hh,(X)/./(27) = I,(x), the Hermitian pro- 
bability integral of the nth order, tabulated in the British Association Tables (1931, 1946). 
An account of these functions has been given by Fisher (B.A. Tables, 1931). Since the 
normal distribution is symmetrical about its mean, these tables may be used for X + ,(X) 
and $(X?+ 1)—J,(X) by changing the sign of the argument. 


6. TABULATION OF PERCENTAGE POINTS 


When z is distributed normally and / is small (less than 0-25) ¢ is negligible (less than 1/10*). 
In the tables below (1) has been used to calculate the 1 and 5 % points for the distribution 
of the standardized quotient of a rectangular variate with range (1—a, 1+) and a normal 
variate (1,8?) for a = 0(0-02)0-10 and # = 0(0-01) 0-05. Similarly (2) has been used for 
the 95 and 99 % -. -ints, and (3) and (4) have been used for the quotient of a triangular and 
a normal variate, a = 0(0-01)0-05 and £ = 0(0-01)0-05. The percentage points of the 
quotients before standardization are given by multiplication by (a/uz). The percentage 
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Table 1. Percentage points of the quotient of a rectangular and an independent normal variate. If y is 
rectangular with range (l—a,1+«a), and x is normal with mean | and variance f?, the table gives 



























































percentage points of (y/x) 
1% Points 5% Points 
eae 0 2 + 6 | 8 10 _ 0 2 4 6 8 | 10 
1002 —_ 1008 
0 1-000 | 0-980 | 0-961 | 0-941 | 0-922 | 0-902 0 1-000 | 0-982 | 0-964 | 0-946 | 0-928 | 0-910 
1 ‘977 | -967| -951| -933| -915| -896 1 ‘984 -975| -960| -944]| -927/ -909 
2 956 | -949| -935| -919| -903] -885 2 968 | -963| -951| -937) -921) -905 
3 935 | -930| -919 904 -889| -873 3 ‘953 | -950| -940| -928)| -914/ -898 
4 -915| -911/| -902| -889| -875; -859 4 ‘938 | -936| -928| -917| -905/ -89]1 
5 *896 | -893/ -885| -873| -860| -846 5 924 -922) -916| -906| -895)| -882 
95% Points 99% Points 
100a 100a 
0 2 4 6 8 10 0 2 4 6 8 10 
1008 1008 ~ 








0 1-000 | 1-018 | 1-036 | 1-054 | 1-072 | 1-090 0 
1 1-017 | 1-025 | 1-040 | 1-057 | 1-074 | 1-091 1 
2 1-034 | 1-039 | 1-051 | 1-066 | 1-081 | 1-098 2 
3 1-052 | 1-055 | 1-065 | 1-078 | 1-092 | 1-107 3 1-075 | 1-080 | 1-092 | 1-107 | 1-123 | 1-140 
+ 1-070 | 1-073 | 1-080 | 1-091 | 1-105 | 1-119 4 
5 1-090 | 1-092 | 1-098 | 1-108 | 1-119 | 1-133 5 





















































Table 2. Percentage points of the quotient of a triangular and an independent normal variate. If y is 
triangular with range (1—2a,1+ 2a), and x is normal with mean 1 and variance f?, the table gives 









































percentage points of (y/x) 
1% Points 5% Points 
100« 1002 
0 1 2 3 4 5 0 1 2 3 4 | 5 

1008 1008 ™ | 
0 1-000 | 0-983 | 0-966 | 0-948 | 0-931 | 0-914 0 1-000 | 0-986 | 0-973 | 0-959 | 0-945 | 0-932 
1 ‘977 | -971| -958| -943] -927) -911 1 ‘984 -979| -969| -956| -943| -930 
2 956 | -952| -943| -931| -917| -902 2 ‘968 | -965| -959| -949)| -938/| -926 
3 935 | -932| -925| -916| -904| -891 3 953 | -951| -946| -939| -929/| -919 
4 *915| -913/| -908| -899| -889| -878 4 -938 | -937| -933| -927/ -919)| -910 
5 *896 | -894/ -890| -883| -874, -864 5 *924| -922; -919| -915)| -908{ -900 

| | 











95 % Points 99% Points 


100a 100« | 
0 1 2 3 4 5 0 ; 1 § 3 4 5 
1008 1008 ™ 


1-000 | 1-017 | 1-034 | 1-052 | 1-069 | 1-086 
1-024 | 1-030 | 1-043 | 1-058 | 1-074 | 1-090 
1-049 | 1-052 | 1-062 | 1-074 | 1-088 | 1-103 
1-106 | 1-120 
1-103 | 1-105 | 1-110 | 1-118 | 1-129 | 1-140 
1-132 | 1-134 | 1-138 | 1-145 | 1-154 | 1-164 
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points of 1/¢ are naturally the reciprocals of complementary percentage points of g. When 
a = 0 we have the reciprocal of a normal variate, and when £ = 0 we have a rectangular or 
triangular variate. The third decimal place in the tables should never be in error by more 
than one. 

7. EXAMPLE OF THE USE OF THE DISTRIBUTION 


The efficiency of a steam boiler may be estimated by burning a measured weight of coal 
of known calorific value, and dividing the heat obtained from the boiler by the heat supplied. 
The formula used for percentage efficiency is H = kKW/C, where kis a constant in a particular 
test, W is the weight of water evaporated in the test, and C the weight of coal burned in the 
same period. The water supplied to the boiler during the test is measured precisely, but the 
water level in the boiler at the beginning and end of the test must be estimated from the 
readings of a water gauge with rectangular error. Suppose that & in a particular short test 
is 11-7, W is estimated as 37501b. with triangular error of range + 300]b. (the difference of 
two rectangular errors of range + 150]b.), and C is estimated as 6001b. with a normal error 
of s.D. 12Ib., H is therefore calculated as 73-125. We are required to set confidence limits 
to this efficiency. 

Here a = 0-04 and # = 0-02; these parameters indicate the relative precision with which 
C and W are measured. The 1, 5, 95 and 99 percentage points of the distribution of the 
standardized quotient are 

0-917, 0-938, 1-064, 1-088. 


These are to be multiplied by (ka/z), i.e. the corresponding confidence limits to E are 
67-1, 68-6, 77-8, 79-6%. 
A 90% confidence interval for # is therefore 


68-6 — 77-8 %, 


The author wishes to thank Mr R. L. Brown for suggesting the problem, Prof. G. A. 
Barnard for his assistance in the preparation of this paper, and the British Coal Utilisation 
Research Association for permission to publish it. 
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AN ESTIMATION PROBLEM IN QUANTITATIVE ASSAY 


By J. AITCHISON anp J. A. C. BROWN 
Department of Applied Economics, University of Cambridge 


1. THE PROBLEM 


The purpose of this note is to show how a simple but common type of heteroscedasticity 
may be treated explicitly in quantitative assay. 

Finney (1947) considered the problem of quantitative response to stimuli in biological 
assay and presented an estimation procedure based on the method of maximum likelihood. 
If wu measures the quantitative response to a stimulus of concentration x, measured on a 
suitable scale, then the model used by Finney is essentially 


u = HP(a+fxr)+e, (1) 
at+fce ] 
where P(a+ Sx) -{ ae (2) 


and ¢ is a normal variate with zero mean and constant variance, independent of x. H, a 
and f are behaviour parameters; H, the maximum expected response, may be known 
a priori, but more frequently has to be estimated along with a and £. The method leads to 
a probit-analysis technique. 

The hypothesis that var (u) = var (e) is independent of z is not always strictly tenable, 
and Finney observed in his worked example of the repellent effect of lime-sulphur on the 
honey-bee that there was a strong indication that the variance of an observation increased 
with decreasing concentration of the repellent. A similar type of systematic heteroscedasti- 
city is found in demand analysis in economics, where Aitchison and Brown (1954) have 
applied some of the methods of biological assay; here, a consumer’s expenditure on a com- 
modity is taken as the response wu and his income, measured on a logarithmic scale, as the 
stimulus x; and there is strong evidence to support the hypothesis that 

var (u) oc {E(u)}*, (3) 
that is, the coefficient of variation of the response is constant. This is well illustrated in 
Table 1, where the standard error and coefficient of variation of the expenditure per person 
on meat is given for ten groups of households classified by income per person. The corre- 


sponding values are also given for Finney’s example; the results for this case are less 
conclusive. 


2. THE ESTIMATION PROCEDURE 


The model proposed is 
u = HP(a+ fae, (4) 
where ¢ is normally distributed with zero mean and constant variance o?. Then 
E(u) = H et* P(x + Ba) (5) 
and var (uw) = (e” — 1) {H(u)}* oc {H(u)}?, (6) 


so that the model satisfies hypothesis (3). There are often good a priori reasons for believing 
that multiplicative errors such as in the model (4) arise in practice. 


| 
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Expenditures on meat* Effect of lime-sulphur on the honey-beet 
Household Standard Coefficient abe Standard Coefficient 
group error of variation Treatmen: error{ of variation 
1 4-6 0-36 A 3-2 0-69 
2 57 31 B 3-3 43 
3 6-5 31 Cc 24-4 -97 
4 8-6 +34 D 13-4 38 
5 91 33 E 26-9 -43 
6 8-9 0-30 F 29-2 0-42 
7 -11-0 +33 G 20-1 -29 
8 10-9 +32 H 24-2 27 
9 12-5 +33 — — _ 
10 16-7 -41 — _ _ 








* Data from the budgets of industrial working-class households collected by the Ministry of Labour 


in 1937-8. 


+ Data from Finney (1947, Table 33). 


{ These standard errors include a contribution from the row and column design of the experiment; 
the analysis of variance showed that this contribution is not significant. 


If we write v = logu and K = log H, then 


v= K+logP+e, 
and the method of maximum likelihood leads to the minimization of the expression 
X(v—K —log P)? 
with respect to K, « and f#. There results a procedure formally similar to that given by 
Finney (in the second edition of his book); in his notation we have the iterative equations 
bS,, + dKS8,. = Sy, 
DS 7 + bKS py = Syy, 
a = ¥—be—6Kz', 


(7) 


(8) 


(9) 


(10) 
(11) 





where 2’ is still the auxiliary variable x’ = P/Z, but the weighting factor is now w = Z*/P? 
compared with Finney’s Z?. The working probit is given by the relation 


v—K-—-logP 
y= i+ oP 
P P 
= (v-Zlog P) +(»-K)7, (12) 
and Y = a)+box (13) 


is calculated from the initial guesses at a and f, as are S,.,, S,,, etc. If a control group, for 
which P = 1, is used, S,,, and S,, must be increased by n, and n,(k—K) respectively, 
where n, is the number of subjects in the group and k is the mean of the logarithms of their 
responses. A separate estimate of 7* may be obtained from an analysis of variance. 

The computations are considerably eased by the use of Table 2. This table gives for values 
of Y = 1-0(0-1)9-0 the corresponding values of x’, w and what may be considered the 
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minimum working probit, Y,,,, = Y—(P/Z)logP, each to four places of decimals. The 
calculations were made by using values of P and Z from Tables of the Probability Function, 
vol. 2 (1942), published by the Federal Works Project Administration for the City of New 
York, and values of —log P from The Probability Integral (1939), vol. 7 of the British Associ- 
ation Mathematical Tables. The values of x’ obtained were checked from the tables of Q/Z 
given in Finney (1947). The work of compiling the table has been carried out by Mr R. 8. 


Bawa, to whom the authors wish to express their thanks. 


Table 2. Table of working probits 
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» Tah. w=P/Z w=Z?/P® nn 2’=P/Z 
1-0 3°4517 0-2367 17-8558 5-0 5-8687 1-2533 
1-1 3-5071 +2421 17-0599 5-1 5-9384 1-3599 
1-2 35626 +2478 16-2837 5-2 6-0088 1-4813 
1-3 3-6183 +2538 15-5272 53 6-0800 1-6202 
1-4 3-6741 +2600 14-7903 5-4 6-1519 1-7797 
1-5 3-7301 0-2666 14-0729 5-5 6-2246 1-9640 
1-6 3-7863 +2734 13-3751 5-6 7-2982 2-1780 
1-7 3-8426 +2806 12-6969 5-7 6-3725 2-4276 
1-8 3-8991 *2882 12-0381 5-8 6-4477 2-7206 
1-9 39558 +2962 11-3987 5-9 6-5238 3-0665 
2-0 4-0126 0-3046 10-7787 6-0 6-6007 3°4771 
2-1 4-0697 +3134 10-1781 6-1 6-6784 3-9675 
2-2 4-1270 +3228 9-5968 6-2 6-7571 4-5571 
2-3 4°1845 +3327 9-0347 6-3 6-8366 5-2705 
2-4 4-2423 *3432 8-4917 6-4 6-9170 6-1394 
2-5 4-3003 0-3543 17-9679 6-5 6-9982 7-2051 
2-6 4-3585 +3661 7-4631 6-6 7-0802 8-5214 
2-7 4.4170 +3786 6-9772 6-7 7-1631 10-1589 
2-8 4:4757 -3919 6-5101 6-8 7-2468 12-2111 
2-9 4-5348 -4062 6-0618 6-9 7-3313 14-8026 
3-0 4-5941 0-4214 5-6322 7-0 77-4165 18-100 
3-1 4-6538 -4376 5-2210 71 7-5025 22-330 
3-2 4-7137 -4551 4-8282 7-2 7-5892 27-797 
3-3 47741 -4739 4-4536 7-3 71-6765 34-923 
3-4 4-8347 -4940 4-0971 7-4 17-7645 44-288 
3-5 4-8958 0-5158 3-7585 7°5 7-8532 56-696 
3-6 4-9572 -5394 3-4375 7-6 77-9424 73-278 
3-7 5-0190 +5649 3-1341 7-7 8-0321 95-628 
3-8 5-0813 -5226 2-8478 78 8-1224 126-012 
3-9 5-1440 *6227 2-5786 7-9 8-2132 167-682 
4-0 §-2071 0-6557 2-3260 8-0 8-3044 225-33 
41 5-2708 *6917 2-0899 8-1 8-3960 305-81 
4-2 5-3349 *7313 1-8698 8-2 8-4881 419-16 
4:3 5-3995 *7749 1-6654 8-3 8-5806 580-25 
4-4 5-4648 +8230 1-4763 8-4 8-6734 811-27 
4:5 5-5305 0-8764 1-3021 8-5 8-7665 1145-6 
46 5-5969 *9357 1-1422 8-6 8-8600 1634-0 
4-7 5-6639 1-0018 0-9963 8-7 8-9538 2353-9 
4-8 5-7315 1-0759 -8638 8-8 9-0478 3425-0 
4:9 5-7998 1-1593 “7441 8-9 9-1421 5033-6 
5-0 58687 1-2533 0-6366 9-0 9-2366 7471-9 
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he 3. AN EXAMPLE 
m, We shall illustrate the estimation procedure based on model (4) by applying it to the 
pf example considered by Finney, although for this case the hypothesis (3) is not well esta- 
wa blished; it allows, however, a convenient comparison with the method used by Finney, 
Z based on model (1). 
8. A preliminary analysis of variance after a logarithmic transformation of the response 
yields an estimate s* of o?. This is given in Table 3 which compares with Table 35 of Finney. 
= | Table 3. Analysis of variance after logarithmic transformation 
_ De Sum of M 
of freedom squares ores. met 
Rows 7 3-193 
Columns 7 0-817 
Treatments 7 72-786 
Error 42 8-530 s?= 0-203 
Total 63 85-326 
Table 4. Computational scheme 
x n v v—K,y bg y x’ nw nwx nwa’ nwy 
3 8 1-370 — 3-012 3-4 3°347 0-4940 32-78 98-34 16-1933 109-7147 
2 8 1-951 —2-431 | 3-9 3-630 0-6227 20-62 41-24 12-8401 74-8506 
1 8 2-977 —1405 | 44 4-309 0-8230 11-81 11-81 9-7196 50-8893 
0 8 3-492 — 0-890 4-9 4-768 1-1593 5-95 0-00 6-8978 28-3696 
-1 8 4077 — 0-305 5-4 5-609 1-7797 2-53 — 2-53 4-5026 14-1908 
-2 8 4-128 — 0-254 5-9 5°745 3-0665 0-848 —1-70 2-6004 48718 
-3 8 4-167 —0-215 6-4 5-597 6-1394 0-216 — 0-65 1-3261 1-2090 
-o| 8 | 4475 | +0093 | — abi _ io same soe — 
74-76 146-51 54-0799 284-0958 
) 
%=1-9597, Z’=0-7234, y=3-8001 
Snwx* Snwax’ Snwa”? Snway Snwx’y Snwy?* 
397-1900 70-2980 56-1197 602-1732 223-1966 1107-8225 
287-1212 105-9824 39-1203 556-7533 205-5093 1079-5937 
110-0688 — 35-6844 16-9994 — 54-5801 17-6873 28-2288 
m= 8-000 ny(k—K)=_0-7440 
24-9994’ 18-4313" 

We take as our initial guess at H, H, = 80, so that K, = 4-382; this gives a maximum 
expected response of approximately H, e!** = 88-5; by the usual graphical determination of 
initial values of « and / we take a, = 4-9 and b, = — 0-5, the same initial values as used by 

, Finney. 

The computational scheme is set out above in Table 4. Values of v, the mean of the 

logarithms of the response, are calculated at each concentration x and v— K, is recorded. 
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Y is easily obtained by (13); y is derived by adding the product of v— K, and P/Z = z’' to 
Ynin.3 &’ and ware recorded from Table 2 and the remainder of the computations completed. 
The iterative equations (9), (10) and (11) are then 
110-0688) — 35-68446K, = — 54-5801, 
— 35-6844b + 24-99946K, = 18-4313, 


a = 3-8001 — 1-9597b — 0-72346K,, 
which give the values 
K = 4-437, a= 4-697, b =—0-478, 


compared with initial values 
K, = 4382, a)=4:9, 6b, =—0-5. 
The covariance matrix of b and K is given by 
o fat = -1 
Six Sry 
and is estimated by inserting s? for o? leading to 


0-003433 0-004900 
0-004900 0-015115 


Then |b—by| = 0-022 < 0-059 = s.z.(b) 
and | K—K,| = 0-055 < 0-123 = s.x.(K), 


so that it is questionable whether a further iteration is necessary. A comparison of observed 
and expected responses leads to a mean square of 0-203, which, when compared with the 
error mean square 0-203, shows that the model fits satisfactorily. Two further iterations 


were actually carried out and the results of the three iterations are brought together in 
Table 5. 


Table 5. Results of successive iterations 








K a b 
Initial values 4-382 4-9 —0°5 
First iteration 4-437 4-697 — 0-478 
Second iteration 4-436. 4-715 — 0-483 
Third iteration 4°4355 4-7158 — 0-4836 




















Quantile effective doses and their approximate confidence intervals may be calculated in 
the usual way; on the results of the third iteration log (ED 50) is found to be — 0-588, and 
the corresponding 95% confidence interval is (— 1-651, 0-125), compared with Finney’s 
values of — 0-256 and (— 1-167, 0-356). It should also be remarked here that different 
estimates of the expected response are obtained by the two methods. For model (1), using 
Finney’s estimates, we obtain for the estimate of Z(u) 


85-59P(4-875 — 0-488z2), 
whereas with model (4) we estimate E(u) by 
el HP(a + bx) = 90-22P(4-716 — 0-484). 
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4. GENERAL REMARKS 


When the number of observations is not large the estimation procedure presented here 
involves little extra labour compared with that based on model (1). This extra work arises 
principally in the logarithmic transformation of the responses and, with the type of syste- 
matic heteroscedasticity (3), this is exactly the transformation (Cochran, 1938) which it is 
desirable to make before applying an analysis of variance technique. For a large number of 
observations the computations become more troublesome, though not prohibitive, and it 
would be desirable to investigate the effect of grouping on the estimates obtained. Also 
the method is directly applicable only where the responses are all positive or all negative; 
the occurrence of zero responses would require some modifications. 


The authors wish to express their gratitude to Richard Stone, Director of the Department 
of Applied Economics, for his helpful criticism during the preparation of this note. 
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THE USE OF THE HANKEL TRANSFORM IN STATISTICS. 
II. METHODS OF COMPUTATION 


By R. D. LORD 
Royal Technical College, Glasgow 


1. THE use oF FouRIER-BESSEL SERIES 


1-1. Ina previous paper (Lord, 1954, hereafter referred to as I), it was shown that when 
an s-dimensional random vector X has a spherical distribution with P(r)dr for the pro- 
bability of r< | X|<r+dr, one can define a characteristic function 


O(p) = T'(ds) 24-2) (rp)-#+1J,,_s (rp) P(r) dr, (1) 
0 
with the associated inversion formula 


P(r) = 2-#HET(Gs)} (rp) Jyalre) O(p) dp. (2) 


In problems of the addition of such vectors it will often be necessary to evaluate (2) 
approximately. The ordinary methods of numerical integration are difficult to apply, since 
the Bessel functions make the integrands oscillate irregularly between positive and negative 
values. However, when the probability is zero outside a certain range, P(r) can be expanded 
in Fourier-Bessel series. This method has been employed by Bennett (1947) for Pearson’s 
random-walk problem, but his treatment is not general and not based on the characteristic 
function. 

If s = 1, the Fourier-Bessel series is an ordinary Fourier series. Suppose that P(r) = 0 
if r > R. Then the characteristic function is 


oo R 
P(t) = I, P(r) cosrtdr = I, P(r) cos rtdr, 


2 (" p R)dr = 
and so al, (r) cos (mmr/R) 1 = 5 9(mn/R). 


The left-hand expression is the coefficient of cos (mzr/R) in the expansion of P(r) in a cosine 
series in the range (0, R); for m = 0 the value given is to be halved. Hence 


cos—. (3) 


Integrating term-by-term 
r 22 1 ,f(mn\ . mar 
F(r) = +5 2m (ge) ene (4) 
where F(r) is the distribution function, i.e. the probability of 0 < |X| <r. 
For general values of s we proceed as follows. A function f(r) can be expanded in the 
interval (0, R) in the series 


f(r) = mint /B) 





| 
| 





ine 


(3) 


(4) 


the 
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where j;, jg, --- are the zeros of J,(x) and 


dn = (2/84 im) F9)] “19(0) Slim) ar 


Taking f(r) = r-*P(r), v = $s—1 and jj, j,, ... as the zeros of Jj, _,(x) we have 


P(r) = 1S nde a(n? B), (5) 
where on = (2H FRG) BHP) Saint Rr (6a) 
9 dm és—1 Von 

-ranevgaa(ee) (2): e 


the integral over (0, R) being replaceable by an integral over (0,00), since P(r) is zero for 
r>R. Integrating, we find 


Fir) = (5) E Puan lB, (7 

where Pa = ria o('z). (8) 
1-2. Ifs=2 P(r) = BI 7 cm o('z ) Jae et), (9) 
me) EDO off; ava ) : (10) 


where j,, jg, -.. are the zeros of J(x). Tables of J(j,,2) by Goodwin & Staton (1948) are 
available to ease computation of P(r). 
Ifs=3 


Je-a0) = Slr) = (2/ar)i sine, Jule) = Jy(r) = (2/mn)' (27 — coer), 


so that j,, = mm and J},(m) = 2/(mn*). Hence 


Ptr) =F Sm mO("R)s in in (11) 
Fir) = z=, R £) (ca 8in iy” — 008"). (12) 


1-3, This is perhaps the most accurate method in general of computing F(r), but the con- 
vergence can be very slow, since it is determined almost entirely by the speed with which 
®(p) decreases. Occasionally convergence can be slightly improved by a preliminary 
integration by parts. In general, we can integrate (2) N times by parts and then expand 
f(r) = r’-**P(r) in a Fourier-Bessel series. The resulting formula for P(r) is then integrated 
to give F(r), but the general result is simple only in the case s = 2, N = 1. The method is 
not usually suitable for P(r), since it means finding a small quantity as the sum of terms 
which are not so small. 
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1-4, When P(r) does not vanish outside a finite range the method may still be usable. 
We consider the case s > 2. Expand P(r) over the range (0, R). The error in using (6) for the 
coefficients arises from replacing the finite integral in (6a) by an infinite integral and is 
proportional to me 
Em -{° ri—teP(r) Jye-1(Jm7/R) dr. 


If we assume that P(r) decreases for r > R, the integrand, which starts from zero at r = R 
and alternates in sign, will have a graph consisting of a series of half-waves of diminishing 
amplitude and nearly equal lengths. Hence | ¢,, | is less than the area under the first half- 
wave, in which P(r) has its maximum at r = R and | r!-#*J,,_,(j,,7/R) | has its maximum at 
r = Rkn/jm, where k,, is the mth zero of J,,(x). Hence 


- k,R 
[em | <2e3—F RP(R) (==) | Jl) | 


and for the error df,,.in £,, we have 


| Bn | < 2RP(R) sem (22) | Jyo-1(Fm) | 


Now (Watson, 1944, p. 200) as x tends to infinity 
T¥e—-1(&) + J¥,(%) ~ 2/(a122), 
so that as m tends to infinity both j,,J}.(jm) and ky, J}, 1(km) tend to 2/7. Also (jmi1—Jm) 


tends to 7. Little error for our purpose is caused by replacing the above expressions by their 
limits and j,,/k,, by 1. Hence 
| 3B». | <{27°/(kmJm)}*# RP(R), 
and éF, the error in F(r) satisfies 
| oF | <(r/R)* & | Bn | 
m=1 


< A(r/R)* RP(R), 


© 1 
where A = (273)t yy 
( ) 7K, 


A depends on s, and adequate rough estimates are not difficult to obtain. For s = 2 we find 
pala ot | 8F | <2-8rP(R). (13) 


A closer estimate could of course be made by examining the terms of the series (7) more 
closely but is not worth while when the estimate is used in the following way. Use the best 
estimate of P(r) to find an R for which the estimated error is substantially less than the error 
one is willing to make and use this value of R in (7). One estimate of P(r) is always available, 
namely, the normal approximation I (36) or the modifications to be given later, but it may 
not be very close and that is why a margin of error is left. 

1-5. Asa test F'(r) for the sum of two coplanar vectors, each with an exponential distribu- 
tion with parameter b, was considered. By I (48) 


roast 
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exactly, and by I (43) @(p) = (1+ 6%p?)-3. 


Hence, by I (18), the second moment is 

fz = 1267. 
The normal distribution with ~, = 12b? was therefore used to estimate P(r). For the sum of 
two vectors the normal estimate is very inaccurate. However, it was judged that with this 
estimate four-decimal accuracy in F(r) should almost certainly be obtained by choosing 
R so that (13) gave | éF'| <-10-7. R = 156 was chosen as a convenient value satisfying this 
requirement, 

The series (7) was then used %o calculate F(r) for the values r = 1-56, 3-06, 6-06, 13-56, 
ie. for r = 0-1R, 0-2R, 0-4R, 0-9R. The errors were found to be + 60, —2, +5, —15 units in 
the sixth decimal place, the true values being 0-226364, 0-587675, 0-933259, 0-999804. 
These errors include the effects of truncating the series (at about the 30th term in each case). 
The trend of the omitted terms showed that the truncation error for r = 0-1R was rather 
more than 30 units in the sixth decimal place, but almost negligible in the other cases. Thus 
the series gave four-decimal accuracy in the worst case and something substantially better 
in the other cases. 

The convergence was slow, partly on account of the large value.of R and partly on account 
of ®(p) being merely the square of the characteristic function of a single vector. For the 
sum of three vectors about 18 terms would have given the same accuracy. The results of 
this test can, however, be considered satisfactory. 


2. EXPANSIONS IN TERMS OF LAGUERRE POLYNOMIALS 


2-1. We now find error terms in the normal approximation by expanding P(r) and F(r) 
in series whose first terms are the normal approximations. From the definitions of the 
cumulants A,,, [I (19)], 


pot lames 2.4. etnarat- , 














i, A A 
*P\ 7 a \(1 + 3Gee 3)” ~ spent}: i) 


say, on expanding te second exponential in powers of p. But this expansion differs from the 
passage I (19) back to I(18) only in the absence of “4, = A, and in replacing the other j’s 
by A’s. Thus putting A, = 0 and writing A,, Ag, ... for Ay, Ag, ... in 1(21) we have 


eS te 
(s + 6) (s+ 8) 
s(s+2) Ase. 


Further values can be found from Kendall (1943, equation (3-30)) by replacing his y,, x, 
by A,,/{2.4... 2v.8(s+ 2)... (8+ 2v—2)}and A,,/{2.4... 2v.8(8 + 2)... (8 + 2v— 2)} respectively. 
In terms of moments 


N v 
Agy = = (-¥(5) (“) (s+ Pa pen ig (s+ 2N — 2v) Men». 


Ag=Aq, Ag=Ag Ag =Agt3 
(15) 
Ajo = Ayot 10 





This follows by applying Maclaurin’s theorem to expand (p) exp ($A,p?/s). 
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Substituting from (14) into (2) 


P(r) = Wolr) + AsValr)-—Agyelr)+---, (16) 
where y,(r) has characteristic function exp (—4A,p?/s) and is therefore the normal pro- 
bability function 

; gary eral sc) exp Late (17) 
. T'(4s) \2A, 2A,)” 


while if V > 0, using Watson (p. 394 (3)), 


1 ° 
aT —4A,p2/s pis+N. 
4. BNs(6 +2) et IND) PAT Gs) OO te-alrP) oP 


oy N+48 : iort/A, ER y, 
= WIPGs) (5x) ee (-2 $8; x) 
2 N-+4s (sr 
s—1,—tsr2/A, [(¢s+1) 
= TGsiN) (gx) Sint te eG Nai ); 


i.e. P(r)/yso(r) = 1+ = yV SHG) 8(-7 48 ax) (19) 


Yon(r) = 3 





(18) 


Here ,F,(a, y; x) is the confluent hypergeometric function 


= 1494 Met! . 


y y(y+1)2! 


while L(x) is the generalized Laguerre polynomial 








ane /d\™" | a+1)(a+2)...(a+ 
Lie) = aa (erate) = EFAS OTM) A(—m, 14052). 


To find the distribution function .we need the value of 


P(r) = \j Wont) dt. 


Using the Laguerre form, and putting u = }st?/A,, U = }sr?/A,, we obtain, for N > 0, 


Poy(r) = = dd 35 — (5) fw yts—l e-u L4s-(u) du 
03 P(4s+N)\2A,/ Jo N 


“Ae l oe 8,49) (4) duld 
“NTGet N\A) Jo dul wa aula 
] s \%¥ 
el ade J) e-U UBids (U 
wrqeum (sx) e U LY? (UV) 


1 ea ae — 
8 eee —U Jyts i. : 
NIT(}s) A, (5\.) e~U U® ,F(—N +1, 48+1; U). 


(20) 


The distribution function is then given by 
F(r) = ¥o(r) + 44 ¥4(r)—Ag P(r) + ---- (21) 


2-2. Fors = 1, the expansion is equivalent to the well-known Type A expansion in terms 
of Hermite polynomials. It is equivalent for the plane random-walk problem to Pearson’s 
expansion in terms of what he calls w-functions, and for the three-dimensional one to an 











(16) 


pro- 


(17) 


(18) 


(19) 


(20) 


(21) 


terms 
rson’s 
to an 
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expansion given by Rayleigh. When the distribution is that of the sum of n vectors with 
identical distributions (cumulants A,, A,, ...) the first few terms are as follows. 
For s = 2, denoting r*/(nA,) by u, 


P(r) = = rel g(a + de") — 5 = (1—3u+ gu2+ 4u8) 








aah 
JE (aa Bu gut ut) — |, (22) 
F —u Ay As 2 
(r) = 1-e 1 pag ll — 4) + Gangs (1 — 4 + du’) 
_A +18nA 23 
“aan u(l— fut dud gut) +..]. (23) 
For s = 3, denoting 3r?/(2nA,) by U, 
9A 
r= (Se) veel + Ag 30 + pe) — og (1-20 + 4022850) 
27 5A, + 63nd? 
BB aaa 80+ 808-0 + ah). | ey 
3A 3A, 
P(r) = afr Jax ~ 7, Ute °|1- ina 001-80) + gst U4 + 0") 
9 5A,+ 63nAz 
renee en bres vee. alae stsU)+...|, (25) 
where a(x) = »/ (2/m)[" e-¥ dt. 
0 


2-3. These formulae have been very little tested for s > 1, but they would appear to behave 
rather like the Type A series (s = 1) and to give satisfactory approximations for nearly normal 
distributions except at the tails. In the case of the distribution of the sum of » coplanar 
random vectors of equal magnitude, Pearson concluded that five terms of the series were 
enough to give four-decimal accuracy for n > 7, but investigations which the author hopes 
to publish shortly suggest that he was rather optimistic. 

The following are the results of a few tests on (23) applied to the distribution considered 
by Pearson; F,,(r) is the distribution function for the sum of n vectors of length a. Take first 
r =a, since F(a) = (n+1)~! exactly. Five terms of (23) gave the following errors in units 
of the fifth decimal place, the corresponding error in the normal approximation being given 
in brackets: 

nm=4: —618(+2120), n= 6: —174(+1067), 
nm=8: — 26(+ 650), n=10: —11(+ 425). 
Next r = na, since F,,(na) = 1 exactly. The errors were now 


n=4: —2584(—1832), n= 6: —501(—248), 
nm=8: — 95(— 34), m=10: — 17(—4-5). 


It is a reasonable conclusion that the approximation is fairly satisfactory except near the 
tail, where the normal approximation can be better. 
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2-4. We can find formulae for approximate normalization (i.e. formulae for r’, where r’ 
is to make Y’,(r’) = F(r) as accurately as possible) by comparing (21) with the expansion of 
Y,(r’) in powers of (r’—1r). The results rapidly become very complicated and we content 
ourselves with 


r’ —r = 8Aqr/(8A3), (26) 
,. sr 8A, 8%(s—1) Xi. 
Lore Baa” —Be+2)48” ~aen3"t Teens” (27) 


For the sum of n vectors with the same distribution, the right-hand side of (26) is the only 
term of order n—!, while that of (27) includes all terms of order n— and n-*. 

These formulae have not been adequately tested but it appears that (26) improves the 
normal approximation substantially for moderate values of r and that the first two terms 
of (27) carry the improvement nearer the tail of the distribution. 

In general, it would appear that for greatest accuracy it would be best to use (19) to 
estimate P(r) and then employ the methods of § 1. 
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A REDUCTION FORMULA FOR NORMAL 
MULTIVARIATE INTEGRALS 


By R. L. PLACKETT 
University of Liverpool 


1. We suppose that the vector x of m random variables with zero means and unit 
variances has a non-singular normal multivariate distribution with probability density 


function , 
Pn(*, Lqy +++, %y3 Cyy,CyQ, +++ Can) = (27)-*" | Cc |texp (= $x Cx). (1) 


Here C is the inverse of the variance matrix of x, which is denoted by R, and has elements 
{p;;}. The integral 


®,,(4,, ao, aeey an; Ci1> Cro; sees Cnn) -| | $,dx,dx, eee dz, (2) 
Aid & an 


has been extensively tabulated for n equal to 1 and 2, but a simple calculation will show 
that comparable tables are scarcely feasible for higher values of n. However, the joint 
distribution of several continuous dependent variables is often assumed to conform to 
multivariate normality, and experiments may arise in which we wish to compare observed 
and expected frequencies, as, for example, in testing models for the joint action of several 
poisons (Plackett & Hewlett, 1952). 

When aj, a», ...,@,, are all zero, we denote the value of ®, by ®°; it can be interpreted as 
the area of a general simplex constructed on the surface of a sphere in n dimensions. Schlafli 
(1858) found a differential recurrence relation for ©°, and showed that, when n is odd, ° 
can be expressed as a combination of values of 09 _,, 09 _,,...,@§. For particular values 
of R, he also gave some exact expressions and several identities. Coxeter (1935) has esta- 
blished further properties of ©? when the correlation coefficients (13, P44 and Po, are all 
zero. When all the correlation coefficients are equal to p, Ruben (1954) has shown that 
Schlifli’s results yield a simple formula connecting ®° with ®°_,; and he gives, in his Table 1, 
the values of ®° for 1/p = 2,8,...,12 


and n= 0,1,2,...,51—1/p. 


Another general approach to the problem is by means of the tetrachoric series, the details 
of which when n is 2 are given by Kendall (1945). This series has been generalized by Kendall 
(1941) and Moran (1948), who state explicit formulae for ®,, when 7 is 3 and 4; but although 
the tetrachoric series will always converge, it does so very slowly when the absolute values 
of the correlation coefficients are near unity, and some alternative approach then appears 
desirable, as David (1953) has indicated. 

A direct attack is occasionally rewarding. Thus, when 

2, p=4 
Cog = -1, p-q=tl, 
0, otherwise, 


Anis & Lloyd (1953) prove that 9 is 1/(n+1). 
Biometrika 41 23 
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In what follows, we obtain a reduction formula for ®,, which permits us to express ®, 
and ®, as finite sums of single integrals of tabulated functions. These integrals must in 
general be evaluated by numerical quadrature, but under certain conditions we shall derive 
simple approximations to them. Schlafli’s differential recurrence formula can be deduced 


from ours by putting suhea ‘haat 
_, = [SF oa = > 


and interpreting the resuit geometrically. 
2. Our starting point is the system of partial differential equations represented by 


0$n/Opis = Ob,/0x, Ox;. (3) 


The equation for n equal to 2 has been known for some time. To establish (3) for all n, we 
write ¢,, as the transform of its characteristic function: 


$, =(2n)-" | | 1g | exp (—it’x—4t/Rt) dt,dt,... dt,. 
Both sides of (3) then become 
_(2n)-n | | ~ | t,t, exp (—it'x —4jt’Rt) dtydt, ... dt. 


We next differentiate ©, with respect to all {p,;}: 


a, fee fe 
a= | 4 (2,2 py) dir, dit, ... dx, 
a a an 


= rr ap (f° (09d, Oa, Ox.) dx, dx,) dx,da,...dx, 
An) % an a,J a, 


ioe) co «o 
=> | | auf ,(44, a>; X3, X4; seey En; C11» Cras ise Cais) dx,dx, oe AXy. (4) 
ay/ an 


To bring this into a more convenient form, we note that the conditional distributions of the 
normal multivariate distribution are expressible in terms of deviations from regression. 


In fact, let ; 
X = (X1, Xo, .--» Lm); 


Xs = (%m+1>Tm+2s woey%n)s 
Cc, : C,, 
and Oe poe, Sea, 
C,,. Cy, 


where C,, is m x m. If the inverse of C, correspondingly partitioned, is 


Ry Rio 
R i. ae nt a A 
Ry Ry» 


then Rj’ = C,,-C,,Cz" C,,, 
{Ru | ” | Cyp|/|C|, 
and R,, Rj! = — Cz'C,,. 


Partitioning x and C in (1), and using the last three equations, we get 
$n = (2m)-™| Ry, |-+exp {— 4x, Ra x;} 
x (277) -#—™ | Cy, |texp {— 4(Xp— Roy Ri X,)’ Cyo(X2—Re,Ri'x,)}. (5) 
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The special case when m is 2 is relevant here. Put 


b, = {(Prr— ParPrz) %1 + (Par — PirP 12) %9}/(1 — pig) « (7 = 3,4, ...,m). 
Equation (4) becomes 


O®,, py, = (2m)? (1 — pig)t exp { — $(aj — 2914, 4, + 3) /(1 — pi)} 
x @,,_9(@3 — bg, ag — Dg, ...,€, — 5,3 Cgg, Cgas ---> Can)- (6) 
Similar expressions for the other first-order partial derivatives can be written down at once. 


3. For convenience in terminology, we consider any variance matrix R as defining a 
point P with co-ordinates {p;;} in a space of (°) dimensions. When 4@,, dp, ...,@,, are fixed, 


the value of ®, depends solely ori the position of P and will be denoted by ®,,(P). Suppose 
that K, with co-ordinates {x;;}, is any point where the value of ®, is obvious or can be 
calculated directly from the tables of ®, and ®,. Let {A,,(t)} be the co-ordinates of the point 
LI which divides KP in the ratio ¢:1—t¢. Then 


Ait) = trig t+ (1 —-t) Ky. 
Write R(t) for the matrix with unit diagonal elements and non-diagonal elements {A,,(t)}; 
thus R(0) corresponds to the point K and R(1) to P. Since 


R(t) = #R(1) + (1—t) R(0), 


it is positive definite for 0<t<1. Denote the inverse of R(t) by C(t), with elements c,,(t). 
C(t) is positive definite for the same range of t, and therefore the type of argument leading 
to equation (6) can be applied at any intermediate point on KP, so that 0®,,/0A,. at the 
point L is obtained from (6) on replacing p;; by A,,(t) and c,, by c,,(¢). 

To derive the basic reduction formula, we integrate the differential element d®,, along 
the line KP, and obtain 


ps OD 
® (P) = ®,(K)+ ——* (J) dA... 7 
n\ ) n( ) ZI" OA ; ( )d j ( ) 


On coming to the numerical evaluation of (7), we shall change the variable of integration 
by waiting Ay = 008 6;;. 

This has the effect of removing (1 — A3,)-+ from the integrand, thus shortening the computa- 
tions, and avoiding the singularity which occurs at the lower limit when x,; is + 1. 

4. There is considerable flexibility in the choice of K, but two general rules can be 
suggested. 

(i) Select a point near to P, although, as will appear when we give an example with four 
variables, the length of the path of integration in the space of the correlation coefficients is, 
by itself, no guide to the amount of care which we have to bestow on the process of numerical 
integration. 

(ii) Choose R(0) to be a matrix of rank (n — 1) with all but one of its correlation coefficients 
the same as those of R(1); the second term on the right of (7) then consists of a single in- 
tegral. To prove that this is always possible, let R,, be the first (n—1) rows and columns 
of R, and partition the remainder of R as before. Denote by R#, the vector obtained from 
Ri, on replacing Pn-1,90 by pat ee Since 


| R| = | Ry, | (1— Re, Ri’ Ris), 


23-2 
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we have to solve 
RR RE = 1 
for px_1,,- On rearrangement, 
(RF — Ray) Ra'(Ris — Ruz) + 2(RH — Rey) Rig Raz — (1 — Ro Rin’ Riz) = 0, 
which is a quadratic equation with positive discriminant. It therefore provides two real 


values of p*_, ,, and either of these is the correlation coefficient of x,_, and 


tn = WX + Woret... + WniTn-v 


When 7 is 3, 
Ps = Pr2P13 t {(1 — Piz) (1 —pis)}* (8) 
and x$ = {(P13 —P12P3s) X + (P33 — P 12/15) X2}/(1 — pie). (9) 
The tables of ©, and ®, suffice to caiculate 
®,(K) = Pr (x, >, 22>, xf >a). 
When 7 is 4, 
(1 — Pig) P34 = Pr4(P13 — Pi2P 23) + Poa(P os — P12? 13) 
+ {(1 — pig — Pig — P33 + 2012/13/23) (1 — pis — pi, — Pig t+ 2P12P14P2a)}*. (10) 


The coefficients in zf are obtained by solving the system of equations 


Vi +PrVetPisVs = Pu 
PieVit Vo +PesVs = Pow 


and PisVitPosYet Vs = Pa 
and are checked by evaluating 


PuVitPuetPuys = 1. 


The combination of probabilities forming ®,(K) can be derived mechanically as follows. 
In the space S of points (x,,2»,23) let S,, S,, S, and 7' be the regions defined by 2, >4,, 
L_ > Ag, X, >a, and xf > a, respectively. There will always exist some null relation of the form 


5,8,5,7 = 0, 
where a bar signifies the complementary set. On expanding 
(S—8,) 8,(S—S,) T = 0, 
we get 8,8,8;T = 8,S8,T + 8,8,T —S,T. 
®,(K) therefore involves at most four trivariate normal integrals. 
5. Our methods lead to the following expression for the trivariate normal integral: 


©,(P) = Pr (x, > @,,%_ >a, 23 > as) 


+ (2m) ‘yg 3% exp {— (aj + a§ — 2a,a, cos 0)/2sin* 9} 
Cos? pas 


- 





om 0, — P12% — P1343) + (P1342 + P1243) COS A — a, cos? A 


: J ll 
sin O(1 — pi, — Piz + 2P:2P;; C08 0 — cos*6)t 140 7 
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(9) 


(10) 
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Suppose, for example, that 
ay, = 1-2, As =— 1-0, ag = 0-5 


1 0-7 0-2 
and R= 1 —0-4]. 
1 


Equation (8) gives 
pi, = 0-14 + 0-699714, 


Taking the critical value to be — 0-559714, and using (9), 
at = 1-160392x, — 1-3719892». 


The inequalities x,< —1-2 and z,> —1-0 together imply z¥ < — 0-020481, and so the set 
§,8,7' is null. Hence 
8, : 8,8,T = 8,T, 


giving ®,(K) = Pr(x,> —1-0,2¥ > 0-5; p% = —0-559714) = 0-587191. 


Since p., and p3, are negative here, we replace 6 by 7 —6 in (11). The second stage of the 
work then consists in the evaluation of 


cos~? (0-4) . 
(2m)-1 exp { — (0-625 — 0-5 cos @)/sin? 6} 
cos~* (0-559714) 
<® — 0-6 —0-15cos 6 + 1-2.cos?6 _ 
1\sin 0 (0-47 — 0-28 cos — cos?@)#” 


To achieve six significant figures in ®,(P), we carry six as far as the final product for the 
integrand, where we step down to five, thus minimizing rounding-off errors. The integrand 
has a maximum near the lower limit and the contribution from this section was estimated 
by the three-eighths rule, using strips of 3,th of the interval. Thereafter, the integrand 
decreases steadily, but the first differences have a maximum, so that Gregory’s formula 
was applied twice, firstly over nine strips of th, and secondly over seven strips of j,th. 
The final result is 0-016343, whence 
®,(P) = 0-603534. 


Of course, less work is required if less accuracy will suffice. In our example, ®,(P) is given 


with an error of only one unit in the fourth decimal place merely by applying the trapezoidal 
rule to the integral. 


6. When a,,a,,... are all zero, equation (7) simplifies considerably, and we are easily 
led to the known results for n equal to 2 and 3. Taking K at the origin, 





1} ao. 


in 
O2(P) = $+ (27) dO = {cos~"( — pj,)}/2m; 


cos? pis 
in in in 
onal ©%(P) = 4+ (4m) | dO + | dO + | as| 
cos" pis cos~* pis COS" pes 


= {008-1 ( — py) + 008-1 (— py5) + cos ( — gg) —7}/477 


Tpglt) = Cpg(t)/{Cpp(t) Cag(t)}*, 


When n is 4, put 


and (7) becomes 
YP) = OK) + (1/402) & | cost oryq(1— AB), (12) 


P<aJ Ky . 
where (p,q,1,7) is a permutation of (1, 2, 3, 4). 
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Two approximations follow. If all the {p,,} are small, we take K at the origin and get 


Oi; pe tpi;- 
The integrals in (12) now group themselves in pairs to give 


O{(P) = {cos ( — p,_) cos" ( — Pg4) + cos ( — pg) Cos? ( — Po4) 
+ cos! (— p44) cos (— pgs)}/4m*—4. (13) 
If we expand (13), ignoring quantities of order p*, we get the first three terms of Moran’s 
formula (3). 
When all the differences {p,;—;;} are small, and provided that o,,(C) is not close to +1, 
we can write 
cos! o,,(t) =~ t cos! o,,,(1) + (1 —t) cos4.0,,(0) = Ag + yg Ajs(t). 


Under these conditions 


py 
) cos! op4(1 —A3,)-# dA, ~ &,_(cos K;; — cos p;;) + Byg{(1 — x7,)# — (1 — p%) 4}. 
KY 


(14) 
This approximation cannot be used when R(0) is a matrix of rank 3, for the equation 














1 Api Ay; I Agi Ay 
(1—02,) = (1—2%) | R(t)| oe : 1 Ay 
1 1 
then implies that 
Ty (0) = +1. 


A brief table of ©$ is given in an appendix, in order to extend the range of (14) by providing 
additional starting-points K. 

7. We shall illustrate the calculation of ® by an example in which all the correlation 
coefficients are fairly large in absolute magnitude. Suppose that 


1 —0-60 0-85 0-75 


1 —0-:70 —0-80 
R= . 
1 0-65 
1 


Sapaties (50) Gores 0-64p%, = 0-4745 + 0-14928580. 


Taking the positive sign 
pi, = 0-97466531 
and xt = —0-287x, — 0-2342, + 1-05523. 
Since S, 8, 8,7 is null, 
©9(K) = Pr (xz, >0,2,>0,2f > 0; py. = — 0-60, p14 = 0-75, po, = — 0-80) 
= 0-067487. 


Turning to the second term in (12), 


—0-60 0-85 0°75 
—0-70 1 cos @ 
—0°80 cosé 1 


1 -0-70 -—0-80 |-+ 4 
— 0-70 1 cos 0 


—0-80 cosé l 


1 0-85 0-75 
0°85 1 cos @ 
0-75 cos@ 1 


= ’ 
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and we thus have the problem of computing 


= (Tr) cos~? — 0-595 + 1-205 cos 6 — 0-6 cos? 0 
cos~* (0-97...) (—0-13 + 1-12 cos 0 — cos? 6)# (— 0-285 + 1-275 cos 0 — cos? 4)? 





| a0. 


This integral presents two features which make the computations more laborious than in 
the previous example. In the first place, cos? must be recorded to eight decimal places in 


order to obtain six in the argument of the inverse cosine. Secondly, this argument is 1 at 
the lower limit, and because 


cos! (1—a) = /(2x) (1+ 2/12 + 3x?/160 + 523/896 + ...) 


the integrand behaves like zt when z is close to zero, so that the usual methods of numerical 
integration break down. The difficulty is overcome by using a formula given by Jeffreys 
& Jeffreys (1946), § 9-092, namely 


3h 
| (xt + fat + yat) dx = h(6 J3y,/7 + 12 /6y_/35 + 16y5/35). 
0 


This was applied with strips of ;};th of the interval, and followed by Gregory’s formula 
over seven strips of z};th, eight strips of J,th and eight strips of th. The final result is 


0-025164, whence ©(P) = 0-042323. 
To test the adequacy of (14), we now work through the same example taking 
1 —1+0-40¢ 1—0-15¢ 1 —0-25¢ 


R 1 —1+0-30¢ --1+0-20¢ 
t) = ' : 
«) 1 1 —0-35¢ 

1 


R(0) is a matrix of rank 1. It corresponds to the system of relations 


from which we infer that 
@$(K) = 0. 
The quantities {o,,,(t)} are computed from the adjoint of R(t), namely, 
0-2175—0-042¢ —0-0775+0-01225¢ —0-1675+0-037% — 0-1275 + 0-0285¢ 
R(t) P 0-1475 — 0-02625t 0-1025 — 0-02375t 0-1225 — 0-02775t 
ii 0-1975 — 0-04¢ 0-0725 —0-014¢t 


0-1775 — 0-036¢ 


As each row of R(t) is completed, it is checked by forming its product—theoretically zero— 
with some other row of R(#). Of the six integrals to be evaluated, a typical one is 





1 01025 — 0-02375¢ 
poets — (1 —0-25¢)%-? cog—? | —— 
pratt £; Ahr dh CSET * oom ( crere—oosmsan eae oo 


__ [ore af = 00075 + 0-095 008 0 
"1. i °S ” \(0-0425 + 0-105 cos 0)! (0-0375 + 0-160 cos 0) 


The values taken by the inverse cosine at the limits of integration are 0-92662 and 0-96446; 
and 0-92662 (1 —t) + 0-96446t = 1-07798 — 0-15136(1 — 0-25t). 








dd. 











358 Reduction formula for normal multivariate integrals 
Hence, using (14), 
Tyg — 1-07798 cos- (0-75) + 0-15136 (1 — 0-752)# = — 0-67898. 
On the other hand, applying Gregory with five strips to the second formulation, 
Tyg = —0-67827. 


Although the length of the path of integration in the space of the {p,,} is double what it was 
previously—0-705 against 0-325—and although the number of integrations has been 
increased from one to six, yet the total amount of work in evaluating ©2(P) to six decimal 
places is roughly the same as before. The exact and approximate results for all six integrals 
are collected in the table below. Approximation (14) therefore leads to an estimate of ©2(P) 
differing from the exact value by less than one unit in the fourth decimal place; and it thus 
appears to work quite satisfactorily, considering that the differences {p;;—x,;} are not 
particularly small. 











Integral Approximation (14) | Numerical integration 

Ty 1-08628 1-08643 
Ii3 = 0-40438 = 0-4037 1 
Iu — 0-67898 — 0-67827 
Ios 1-80380 1-80439 
In 1-60801 1-60864 
Iu, — 1-74700 — 1-74661 

Total 1-66773 1-67087 

+4n? 0-042244 0-042324 

















8. The calculatic: of ®, by our method is similar to, but more laborious than, the calcu- 
lation of ®,. Once again, single integrals will suffice. If suggestion (ii) is accepted, ,(K) 
can be expressed as a trivariate normal integral and is evaluated as described above; the 
integrand of the remaining term is a product of probabilities and ordinates of the normal 
bivariate distribution. For ®, and ®,, double integrals are required, and, in general, the 
effect of repeatedly applying equation (7) is to reduce the multiplicity of a normal integral 
by more than half. Whether our results offer a practical method of approach when n exceeds 


4 is a moot point, but they are perhaps worth considering when values of ,, ®,, ... are 
urgently needed. 


I am indebted to a referee for simplifying my original proof of equation (3). 
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APPENDIX 


Our method of calculating ®, depends on knowing the values of this function for certain 
values of R. Such knowledge need not be systematic, however—as would be essential if 
we were interpolating—and consequently the values of ®{ given below, although forming 
arather haphazard collection, may nevertheless be useful. Since the results of Anis & Lloyd 
(1953) and Ruben (1954) are available in recent issues of this journal, they are not reproduced 
here. 


(A) 1 pe 9 9 
1 0 
R= eG 3 
1 Psa 
1 
Put Pig = —COSA, Pog =—COsf, py = —Cosy, 
where O<a<hn, 0<f<am, O<y<}hr. 


The relationship between the function f(«, #,y) of Schlafli, the infinite sum S(a, £,y) of 
Coxeter, and ®$, is expressed by 
Of = f(a, 2, y)/16 = S(j7—a, £, $n — y)/87°. 


The following table was computed from a set of exact values of f(a, 8, y) given by Schlafli 
(third paper, p. 98); the first ten are also derived by Coxeter: 








—Pire — Pes —Psa 0 
0-500000 0-500000 0-500000 0-008333 
-707107 -500000 -500000 -002604 
-500000 -707107 -500000 -000868 
-809017 -500000 -500000 -000069 
-309017 -500000 -500000 -013264 
-809017 -500000 -309017 -001389 
-309017 -809017 -500000 -000278 
-500000 -309017 -809017 -005278 
-809017 -309017 -809017 -000417 
-309017 -809017 -309017 -004583 
0-500000 0-500000 0-790569 0-000408 
-500000 -790569 -250000 -001631 
-790569 -250000 -790569 -002446 
-500000 -309017 -925615 -000217 
-309017 -925615 *135045 -000930 
-925615 -135045 -809017 -001624 
-135045 -809017 -500000 -002301 




















From each value of 9, five others can be generated by changing the signs of the variables 
%1,X%_,%, and 2,. For example, 


] 0 0 1 — 0 0 

4 1-4 0 . : 

o} * “ ; =o} 1 -3|-o8 ~ 
“ 3 bi , 


1 1 
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Thus, the set of six associated with the first tabular entry is as follows: 








Formation y= Pos Psa co 
—* —+ —+ ris 

—% + <2 == ‘to 
—%y, —Xq -+ + —+ ts 
—X, 4 4 —- rc 
—Hy, —X% $ —3 + tvs 
—%, —Xe + $ + is 























(B) Two more values of Of are obtainable by elementary combinatorial methods, based 
on a set of uncorrelated random variables y,, yo, ..., Ys, all of which have the same distribution 
and variance 4. For example, the first R is the variance matrix of y,—¥4,, ¥,—Y1, Y3— Ya 
Y4—Ye; and, out of 4! ordered arrangements of y,, Yo, Y3, Yq, there are (2!)* which ensure that 
all four differences are positive. Hence ®{ is } whether or not anything further is specified 
about the distribution of x,, x2, x3 and 24. 











Formation R toy 
13 1440 ; 
14 1 0 3 
23 1 } 

24 1 
12 : o44-0 * 
13 1} 0 
15 1 4 
45 l 

















The first R belongs to a set of four; and the second, to a set of six. 
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ON THE COMPARISON OF TWO MEANS: FURTHER DISCUSSION 
OF ITERATIVE METHODS FOR CALCULATING TABLES 


By W. H. TRICKETT anp B. L. WELCH 
Leeds College of Technology and University of Leeds 


1. INTRODUCTION 


One of the present authors (Welch, 1947) has given a solution of the problem of comparing 
two means, which has formed the basis of tables calculated by Alice A. Aspin (1949). This 
solution was presented in a somewhat condensed form, and has been criticized on the ground 
that it is not easy to follow. It is therefore proposed in the present paper to give a more 
extended treatment of the problem in the hope that certain points, at least, will be clarified. 

We do not intend to proceed immediately to the original solution (which was given as 
a series development), but to discuss first a numerical iterative method which possibly 
demonstrates better what is being attempted. The connexion of this numerical method with 
the series will then be shown. 


2. FORMULATION OF PROBLEM 


It is assumed that n, individuals are available from a normal population with mean X, and 
standard deviation o,; and n, individuals from a second normal population with mean X, 
and standard deviation o,. The corresponding sample statistics are Z,, 8,, Z, and s,. We wish 
to make probability statements about the difference, (X, — X,), between the two population 
means. 

It is well known that (%,—Z,) is distributed normally about (X,—X,) with variance 
(o?/n, + o3/n,). If o, and 7, were known, therefore, it would be possible to refer the ratio 


_ %1—%2)— (X,—X2) 
V(o4/m, + o3/M2) 





(1) 


to the standard normal tables. 
If the o’s are not known it is natural to consider instead the ratio 


_ (%—%,)—(X,—X,) 
V(si/my + 8i/mg) 
where now the true sampling standard deviation of (%,—%,) is replaced by an estimated 


value. (Nothing is being assumed about the ratio o,/a,, so that oj and oj are estimated 
separately by s? and s2.) It is known that the ratio M, = s?/o{ has the standard mean-square 


distribution 
iy (fM\* 5 (£4 
p(M)dM = ran’ | =) a( ~ ), (3) 


where f = (n,—1) =f, (say), while M, = 53/03 is distributed similarly with f = (ng—1) = jf, 
(say). Also these mean-square distributions are independent of the distribution of u. Using 
these facts, the probability that v is less than some specified value vy may then be deduced 
as follows. 





(2) 
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From (1) and (2) we have v = uM, y+MU,(1-y)}-, (4) 
(o7/m) 
aye ¥ = (elim, +0¥m,)” ®) 
Hence, for given s? and 8? (i.e. for fixed M, and M,) we have 
Pr (v <9) = W {y{(Myy +M,1—7)] %}, (6) 
where N{x} = f° Fem e-** du. (7) 
Thus for wnrestricted s? and s3 it follows that 
Pr(v<vg) = [° | "(yh + Mh T=7) %} MG) PMG) aM dM (8) 
oe _ fm ™ 
By writing b= (f, mM, +fM,) », v= (fm, +f2M,), (9) 
this may be transformed to 
De ees yb | (1—y) (1-6) 
mecn=f [Lays BEY) aetna, 
HS, +f,)-1 
where p(w) dw = ar ew (3) ‘ a(5) ‘ (11) 
(Az) 
and p(b)db = HUW) b-1(1 — b) #1 db, (12) 
v BJ 
On replacing N by the explicit expression (7) it is found that we can integrate (10) out for w, 
leaving : 
i nave yb, (1—y) (1-6) 
Pr(v<v%) = [i Mover VfitSe) JG v te ) », p(b) db, (13) 
x 1 dt|./F 
where Ty{x} = re Baa ara (14) 


In the transition from (8) to (13) the normal probability integral, N, has been replaced 
by the function Tj, ,,), which is the probability integral of the Student distribution with 
(f:+f,) degrees of freedom. Since good tables of the Student integral exist (Pearson & 
Hartley, 1954, Table 9), the evaluation of Pr (v < v,) is therefore reduced by (13) to a single 
quadrature. (It does not seem, in general, possible to simplify further than this, although 
in the particular cases y = 0 and y = 1, the integral may be shown to reduce to 7; {v9} and 
T;, {v9} respectively. These cases correspond to 7, = 0 and o, = 0, and from direct con- 
siderations it can be seen that v is then actually distributed in the Student distribution.) 

It is seen from (13) that Pr (v < vy) depends only on the population parameters through the 
quantity , which from (5) is seen to depend only on the ratio of 7, and o,. The value, %, 
such that Pr (v<v,) has some specified value P, say, is therefore a function of y. Let this 
function be ¢(y). (It is understood, of course, that ¢ involves f,, f,, and P as well as y, but 
it is not necessary to write this down explicitly.) Provided then that ¢() is chosen to satisfy 


the equation rw f * Det Lv +p / (2 4 “no - ”)) or)| p(b) db, (15) 


we shall have Pr {v< d(y)} = P. (16) 














~~ oe 





(4) 
(5) 


(6) 
(7) 


(8) 
(9) 
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Given a table of ¢(y), obtained by solving (15) for a number of different y, we would be 
able in theory to look up the P-significance level of {(%,—%,) —(X,—X,)}//(s?/n, +83/n,) 
in any particular problem and hence make an inference about (X,—X,). This, however, is 
only in theory for, in general, we shall not know y and hence will not be able to enter the 
table. As an approximation we might estimate y from the sample by means of the quantity 


83/04 


°= (en, + 83]n,)’ (17) 


and then adopt ¢(c) as our critical value of v. If this is done, however, we shall not have 
Pr {v < d(c)} now exactly equal to P. For ¢(c) is itself a random variable, varying about ¢(y). 

If one wishes to make a statement which shall have a chance exactly equal to P of being 
right, it seems that ¢(c) will have to be replaced by a slightly different function of c—say 
v(c). We seek then to find a function v(c) such that 


Pr{v<v(c)}} =P (18) 


exactly, whatever y may be. One may be optimistic in hoping such a function to exist. 

Whether a solution exists, or not, however, let us assume for the moment that one does 

and see how one might set about calculating it. 

je My , 
(M,y +M,1—y) 





From (17) we have (19) 


and hence from (4) 


Pr {v< v(c)} = Pru < /(M,y+M,1-y) of Perera —)}. (20) 





For given M, and MU, we have, therefore, 


hates M, 
Pr {v< v(c)} = N{ hy + MI=7) osu) (21) 


Hence for unrestricted M, and M,, 


wo Po M, 
Pr{o<o(ey} = [|| Vibhy+IhI=7)o( ap gp pas)} PMR) PLM) AM ay, (22) 


On making the transformation (9) this now leads to 


Peto) = fj Manali ri (Fagen) PO 








(23) 
The expression on the right of (23) is to equal P for all y. Thus we have to solve the integral 
equation 1 ‘eit a 
P= [i Doss With) | P+ — AE) we} mab, (24) 
b=0 fi fe 
where in the expression v(c) it is understood that 





© yo +(—y) (1—Oife 


The unknown in the equation is the functional form v(c) which appears non'-linearly. It is 
not to be expected, therefore, that a numerical solution will be easy to obtain. 
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3. AN ITERATIVE METHOD OF SOLUTION 


Suppose that from independent considerations a first approximation—v,(c), say—to the 
solution of (22) is known, and that we write 


v(c) = v9(c) + r4(c). (26) 
Then, if higher powers of v,(c) than the first are ignored, (24) becomes 


P= fo Tyssolititt) [p+ °—4E—)) ose) ae) ad 


ffs tam 


«Tirso Mh tds) | (+E) ose} aya. (20 


If we can obtain v,(c) to satisfy equation (27), then we might expect that {v9(c) + v,(c)} will 
be an improved approximation to the solution of (24)—how much improved depending on 
the magnitude of the neglected terms v?, etc. Now although (27) is a linear integral equation 
for v,(c) it is still not easy to solve, and to make rapid progress further simplification appears 
to be necessary. Such simplification may be introduced by applying to the second integral 
in (27) a certain crude approximative procedure which will now be explained. 

The distribution, p(b) db, given in equation (12) has mean value at 6 = f,/(f, +f.) and has 
variance of order 1/f (here f is used collectively to denote f, and f,). It follows that with large 
f the distribution will be closely concentrated about /,/(f,+f,) and that therefore an in- 


1 \ 
tegral of the form | g(b) p(b)db will be approximately equal to a5 f 7) . This will be true at 
0 1 


all events provided g(6) is not changing in an awkward way in the vicinity of f,/(f,+/,). 

Now when 6 = f,/(f,+ 2) we have from (25), c = y, and the above method applied to the 
second integral of (27) gives simply ,(y) T(;,+;){vo(y)}. If then J, is written for the first 
integral in (27) this equation yields 





P=I1,+,(y) Tt,+46%Y)}> (28) 
_ a a 
yo "a(y) = Tip+ry ol} (29) 


For any given y, J, can be obtained by quadrature and hence (P—J,). The quantity 
T(;,+4)X%o(Y)} is simply the ordinate to the Student distribution with (f,+/,) degrees of 
freedom evaluated at the point t = v9(y). We then obtain v,(y) from (29). By taking a suffi- 
cient number of values of y we can therefore tabulate v,(7). Since v,(c) is the same function 
of c as v,(y) is of y this is equivalent to tabulating v,(c). 

The function v,(c) thus obtained will not exactly satisfy (27) because of the crude approxi- 
mation made to the second integral. Nevertheless, used in (26) this v,(c) may yet bring us 
appreciably closer to a solution of (24). With this fresh approximation we can start off 
a further cycle of the whole process and continue thus ad lib. The usefulness of the method 
must be judged by the way the successive approximations behave. Therefore before pro- 
ceeding to further general discussion it may be advisable at this point to show how it works 
out in a particular case. 








ag Pp . 
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4. A PARTICULAR NUMERICAL TRIAL 


Let us suppose that the sample sizes are n, = 21 and n, = 21, so that the estimates s? and 

s of of and of are each based on 20 degrees of freedom. Suppose that we wish to calculate 

two-sided 90 % confidence limits for (X,—X,). This will be straightforward if we can find 

v(c) such that Pr {v < v(c)} = 0-95. (For P = 0-05 we have simply to change the sign of v(c).) 
From (24) the equation to be satisfied is 


1 
0-05 = [Tol Vi2yb+2(1—y) (1—b)] (€)} (0) db, (30) 
1 
and it is understood in (30) that 
¢ = yb/{yb + (1—y) (1—5)}. (32) 


Since in large samples v is approximately normally distributed a first approximation to 
v(c) is vo(c) = £, where is such that N(£) = P. (For P = 0-95 we have & = 1-64485.) We 
shall use this value to start our first cycle. Since this first approximation does not depend 
on c there is some simplification in the work which will not appear in later cycles. 

We need to calculate first 


1 
Ig = Pr {v < v9(c)} = [/_ Motvt2re + 2(1—~+) (1—6)] (1-64485)} p(b) db. (33) 


for a sufficient number of values of y. To begin with we have taken y = 0, 0-1, 0-2, 0-3, 0-4 
and 0-5. (Values for y = 0-6, etc., will follow by symmetry.) 

Since J, is to be calculated by quadrature we must also choose a net of values of b. Again 
somewhat arbitrarily we have taken b by intervals of 0-1. With this net it is found in the 
present example that J, can be obtained to five decimal places for all y. It is found, more- 
over, that the simple trapezoidal rule suffices to give this accuracy. (To satisfy ourselves on 
this point we have in certain instances doubled the number of ordinates and verified that 
the same answers are obtained.) The reason for the rather surprising accuracy of the trape- 
zoidal rule lies in the fact that the ordinates contain the factor p(b) which has high order 
contact at the ends of the range. The same method of quadrature works also satisfactorily 
on later cycles of the method. 

The values of 7) corresponding to these y and 6 are set out in Table 1. They were obtained 
by second-order interpolation into Pearson & Hartley’s (1954) Table 9. In the final column 
of Table 1 is given 44(b), and in the final line of the table is given J, obtained by quadrature 
from (33). (As has already been mentioned when y = 0, v is actually distributed in the 
Student distribution with f = 20 and hence Pr (v < 1-64485) is then equal to 7,,5(1-64485). 
Directly from tables this is seen to be 0-94219, confirming our quadratured value.) 

Inspecting the values J, in Table 1 we see how Pr (v < 1-64485) depends on y (and hence 
on the ratio 7,/0,). The value is never much different from P = 0-95, which shows that the 
assumption that v is normally distributed about zero with unit standard deviation never 
has very serious consequences, whatever y may be. Suppose, however, that we wish to 
choose v(c) to bring Pr{v<v(c)} even nearer to 0-95. Then, following the method of the 
previous section, we need to calculate first 


0-396457 
Tso(%o(Y)} = 


1 4 oly)? pr oo 


~ 40 
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Since v)(y) = 1-64485 this gives 0-103634, whatever y may be. Hence (29) yields 

v,(y) = 9:64931(P—I,). (35) 
These values are given in Table 2. It will be noted that although v,(y) is given to five decimal 
places it can only be correct to four since the (P—) are multiplied by about ten. The 


limitation on accuracy is imposed by the fact that the tables of 7’ which we have used are 
given to five decimals and hence J, could only be calculated to five decimals. 





Table 1. Tyo{ [2b + 2(1 —y) (1—b)] (1-64485)} 










































































*~ 0 0-1 0-2 0:3 0-4 0-5 asp(b) 
0-0 0-98743 0-98344 0-97802 0-97066 0-96045 0-94608 0-000000 
0-1 -98344 -97926 -97390 -96698 *95796 -94608 -000036 
0-2 -97802 -97390 -96888 -96277 -95530 -94608 -006348 
0-3 -97066 -96698 *96277 -95796 *95243 -94608 -073374 
0-4 96045 -95796 *95530 *95243 *94937 -94608 *244045 
0-5 -94608 -94608 -94608 -94608 -94608 -94608 *352394 
0-6 0-92547 0-93024 0-93465 0-93874 0-94255 0-94608 0-244045 
0-7 *89501 -90871 -92032 -93024 -93874 -94608 -073374 
0-8 *84825 ‘87871 -90215 -92032 *93465 -94608 -006348 
0-9 *76687 *83519 ‘87871 -90871 -93024 -94608 -000036 
1-0 -50000 *76687 *84825 -89501 -92547 -94608 -000000 
I, 0-94219 0-94365 0-94474 0-94549 0-94594 0-94608 — 

Table 2. Calculation of first corrections 
y 0 0-1 0-2 0:3 0-4 0:5 
Ip 0-94219 0-94365 0-94474 0-94549 0-94594 0-94608 
Pry, -00781 -00635 -00526 -00451 -00406 -00392 
04(y) -07536 06126 -05076 04352 -03922 -03782 
P=0-95, v,(y) = 9-64931(P —I,). 
Table 3 
c 0-0 or 1-0 0-1 or 0-9 0-2 or 0-8 0-3 or 0-7 0-4 or 0°6 0-5 

»,(c) 0-07536 0-06126 0-05076 0-04352 0-03922 0-03782 

v9(c) + 04(c) 1-7202 1-7061 1-6956 1-6884 1-6841 1-6827 









































((v(c) + ¥,(c)) equals new v,(c) for second cycle.) 


In Table 3 the values of v, are rewritten against c and then added on to v,(c)—in this case 
1-64485 whatever c. The resulting sum is our next approximation to v(c) and will form the 
new »v,(c) for the second application of the method. At this state we have cut down to four 
decimal places, as this is all that can be guaranteed. 








35) 
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5. NUMERICAL TRIAL—SECOND CYCLE 


Having obtained our new approximation, v(c), to v(c) the next step is to see how much 
improvement it has produced. This necessitates a recalculation of J, from the equation 


I, = Pr{v<v,(c)} = Tyo{/[2yb + 2(1 — y) (1 —)] v9(c)} (6) db. (36) 
b=0 


In this cycle v,(c) is no longer constant but changes with c where, for substitution in (36), 
cis given in terms of b and y by (32). In Table 4, therefore, we exhibit the values of c corre- 
sponding to the sets of y and b which we are using. 


Table 4. ¢ = yb{yb+(1—y)(1—56)}4 








Se 

b yg 0 0-1 0-2 0-3 0-4 0-5 
0-0 0 0-00000 0-00000 0-00000 0-09000 0-0 
0-1 0 -01220 -02703 *04545 -06897 0-1 
0-2 0 -02703 -05882 -09677 -14286 0-2 
0-3 0 *04545 -09677 *15517 *22222 0-3 
0-4 0 -06897 -14286 *22222 -30769 0-4 
0-5 0 -10000 -20000 -30000 0-40000 0-5 
0-6 0 0-14286 0-27273 0-39130 0-50000 0-6 
0-7 0 -20588 +36842 -50000 -60870 0-7 
0-8 0 -30769 -50000 -63158 *72727 0-8 
0-9 0 -50000 -69231 -79412 *85714 0-9 
1-0 —_ 1-00000 1-00000 1-00000 1-00000 1-0 





























Table 5. v9(c) for second cycle 








ng 0 0-1 0-2 0-3 0-4 0:5 
0-0 1-7202 1-7202 1-7202 1-7202 1-7202 1-7202 
0-1 1-7202 1-7183 1-7160 1-7133 1-7101 1-7061 
0-2 1-7202 1-7160 1-7115 1-7065 1-7012 1-6956 
0-3 1-7202 1-7133 1-7065 1-6999 1-6937 1-6884 
0-4 1-7202 1-7101 1-7012 1-6937 1-6879 1-6841 
05 1-7202 1-7061 1-6956 1-6884 1-6841 1-6827 
0-6 1-7202 1-7012 1-6900 1-6843 1-6827 1-6841 
0-7 1-7202 1-6951 1-6851 1-6827 1-6843 1-6884 
0-8 1-7202 1-6879 1-6827 1-6851 1-6900 1-6956 
0-9 1-7202 1-6827 1-6879 1-6951 1-7012 1-7061 
1-0 Mi 1-7202 1-7202 1-7202 1-7202 1-7202 





























If y = 0 and 6 = 1 then c is indeterminate, but lack of knowledge of this does not affect 
our subsequent quadrature, since p(b) = 0 at b = 1. 

The values of vp(c) corresponding to the c of Table 4 are obtained by interpolating into 
the last line of Table 3. The results are set out in Table 5, and the corresponding values of 
Tyo{/[2yb + 2(1 —y) (1 —5)] v(c)} are given in Table 6. (Values for 6 = 0 and 6 = 1 are not 
included as they contribute nothing to the quadratures.) The last line of Table 6 gives the 
values of J, calculated from (36). 
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It is clear from Table 6 that a great improvement has been made in J,. Whereas previously 
we had Pr {v < 1-64485} differing from 0-950 up to as much as 8 units in the third decimal 
place, we have now with our first correction Pr {v < v9(c)} = 0-950 to three decimal places 
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throughout. 


Table 6. Tyo{/[2yb + 2(1—y) (1 —b)] v9(c)} for second cycle 

























































































nS 0 0-1 0-2 0-3 0-4 0-5 Psp(b) 
0-1 0-98688 0-98320 0-97838 0-97201 0-96353 0-95213 0-000036 
0-2 -98222 -97838 -97361 -96769 -96033 -95113 -006348 
0-3 *97577 -97201 -96769 -96271 -95699 -95044 -073374 
0-4 -96660 -96353 -96033 -95699 *95354 -95002 +244045 
0-5 95344 -95213 -95113 -95044 -95002 -94988 | *352394 
0-6 0-93411 0-93658 0-93963 0-94298 0-94647 0-95002 0-244045 
0-7 -90488 -91507 -92518 *93455 -94298 -95044 -073374 
0-8 *85845 *88467 -90708 -92518 -93963 95113 -006348 
0-9 -77688 *84062 *88467 -91507 -93658 95213 -000036 
I, 0-94958 0-94959 0-94974 0-94990 0-95001 0-95005 — 
Table 7. Calculation of second corrections 
y 0-1 0-2 0-3 0-4 0-5 
I 0-94958 0-94959 0-94974 0-94990 0-95001 0-95005 
(P—I,) -00042 -00041 -00026 0-00010 — -00001 — -00005 
[Tio(vo(y))]-* | 10-90 10-66 10-47 10-35 10-27 10-25 
»,(y) 0-0045 0-0043 0-0027 0-0010 —0-0001 —0-0005 
Table 8 
c 0 or 1-0 0-1 or 0-9 0-2 or 0-8 0-3 or 0-7 0-4 or 0-6 0-5 
U9(c) 1-7202 1-7061 1-6956 1-6884 1-6841 1-6827 
0,(c) 0-0045 0-0043 0-0027 0-0010 —0-0001 —0-0005 
V9(C) + 0,(c) 1-7247 1-7105 1-6983 1-6894 1-6840 1-6822 





























{v9(c) +0,(c)} equals new v(c) for third cycle 
Now applying our general procedure to improve this still further we have from (29) and (34) 
o(y) = (P— Ly) [Teofro(y)}]> (37) 

“i 2.522341 + {oot PY" (PI). 


The calculation of these corrections is shown in Table 7. 
In the second line of Table 8 the v, are set out again against c and in the final line they are 
added on to v,(c) to give now our third approximation to v(c). 








ly 
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6. NUMERICAL TRIAL—THIRD CYCLE AND DISCUSSION 


A third cycle of calculations has been carried out starting with the new approximation 
derived in the previous section. This cycle will not, however, be described here in detail, 
since no new features are involved in the calculations. Instead, the final results of the third 
cycle are simply summarized in Table 9. This table also repeats the salient points from the 
earlier cycles so that a general view of the successive iterations may be obtained. 


Table 9. Summary of calculations for f, =f,= 20 





0 or 0-1 or 0-2 or 0-3 or 0-4 or 
1 





. 0 0-9 0-8 0-7 0-6 rt 
Initial approx. to v(c) 1-6449 1-6449 1-6449 1-6449 1-6449 1-6449 
Ist correction to v(c) 0-0754 | 0-0613 | 0-0508 | 0-0435 0-0392 0-0378 
2nd approx. to v(c) 1-7202 | 1-7061 1-6956 | 1-6884 1-6841 1-6827 
2nd correction to v(c) 0-0045 | 0-:0043 | 0-0027 | 0-0010 — 0-0001 — 0-0005 
8rd approx. to v(c) 1-7247 1-7105 | 1-6983 | 1-6894 1-6840 1-6822 
8rd correction to v(c) 0-0000 | 0-:0002 | 0-0002 | 0-0000 — 0-0003 —0-0004 
4th approx. to v(c) 1-7247 | 1-7107 | 1-6985 | 1-6894 1-6837 1-6818 





0 or 0-1 or 0-2 or 0-3 or 0-4 or 0-5 
1-0 0-9 0-8 0-7 0-6 

















I, [i.e a Se for Ist approx. 0-94219 | 0-94365 | 0-94474 | 0-94549 0-94594 0-94608 
(0-9 —I,) ‘00781 | -00635 | -00526 | -00451 -00406 -00392 


Iy bs e. Pr (v<v(c))] for 2nd approx. | 0-94958 | 0-94959 | 0-94974 | 0-94990 0-95001 0-95005 

















-95000 — I) “00042 | -00041 00026 | -00010 | — -00001 | — -00005 
I, r e Pr (v<v(c))] for 3rd approx. | 0-95000 | 0-94998 | 0-94998 | 0-95000 0-95003 0-95004 
0-95000 — I,) -00000 | -00002 | -00002 | -00000 | — -00003 | — -00004 

I, [i.e Pr (v<v(c))] for 4th approx. All within 0-95000 + 0-00002 














The top half of Table 9 shows the successive approximations to v(c), whereas the bottom 
half shows the calculated values of J, = Pr {v < v(c)} which are obtained using these approxi- 
mations. J, in each case depends on y = o?/(a? + 03), and the object of the method is finally 
to produce a v(c) such that Pr {v < v(c)} = 0-95000, irrespective of y. We see that after the 
third cycle all the J, have been brought to within 0-00002 of the required value. 

We could attempt to improve upon this by proceeding to a further cycle, but the labour 
seems scarcely worth while since we are approaching a stage where rounding off errors may 
begin to count. If further accuracy were required it would strictly be necessary to work to 
an extra decimal place throughout and then round down at the end. As far as we have gone, 
the final approximation to v(c), given to four decimals in. Table 9, may be in error by two or 
three units in the last figure. 

We shall return again later to the question of the accuracy which this numerical method 


24-2 
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can provide. Before doing so, however, we shall show briefly in the next section how the 
method connects up with the original series solution upon which such tables as are so far 
published are based. 


7. DEVELOPMENT OF SOLUTION IN POWERS OF 1/f 


The integral equation to be satisfied by v(c) was given in a form involving a single integration 
in equation (24) above. The iterative method described in §3 was applied to the equation 
in this form. The same iterative method, however, could have been applied equally well in 
theory to the equation in the original form (22), involving a double integration over M, 
and M,, viz. 


in { 7 [-(vakr+mI=y v(c)} p(M,) p(M,) dM, dM, (38) 


where in the expression v(c) it is understood that 
c= My{M,y+ M,(1—y)}". (39) 


Writing, as before, v(c) = v9(c) + v,(c) in (38) and neglecting powers of v, higher than the 
first we obtain an equation similar to (27), viz. 


P= in ft N{V(M,y + My 1 —y) v9(c)} p(M,) p(M,) dM, dM, 


ao fo) —— 
+[ [. [V(M,y + M,1—)v,(c)] x N’{/(M,y + M1 —} v9(c)} p(y) p(M,) dM, dM, 
(40) 
ie. P = 1+, (say), if we use summary letters to denote the two integrals in (40). 
Now the distribution, p(M,)dM,, has mean at M, = 1 and variance 2/f,. Similarly, MU, 


has mean unity and variance 2/f,. With large f, and f,, therefore, p(M,) p(M,)dM,dM, is 
concentrated closely about the point (1, 1). An integral of the form 


| | g(M,, M,) p(M,) p(M,) dM, dM, 


will in these circumstances be approximately equal to g(1,1) provided g(M,, M,) is not 
changing awkwardly near (1,1). If this approximation be applied to J, we have, instead 


of (40), P = h+0,ly) N'fogly)}, (41) 
_ (P-h) 
fe v,(y) = Voy} (42) 


This equation is similar to (29) and may be used in the same way as (29) to provide 
repeated corrections to the estimated value of v(c). Instead of dividing (P—J,) by the 
ordinate to a Student distribution we are in (42) dividing it by the ordinate to a normal 
distribution. This, however, is a small detail. The main difference is that in (42), J, is a 
double integral over M, and M,. This would present a formidable problem if it had to be 
calculated by quadrature. For numerical work it is undoubtedly better to transform to b 
and w by equations (9). However, if we wish to proceed differently and produce explicit 
algebraic expressions for the successive corrections to v(c) in groups of terms involving 
successive powers of 1/f, it is perhaps slightly easier to work from (42) where J, is conceived 
as an integral over M, and M,, 
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Suppose v,(c) is an approximation to v(c) which is correct to order f— (say), so that v,(c) 
is of order f-*+. (In general, expansions in 1/f of the nature we are discussing involve the 
half-integral powers, but owing to the symmetry of the present problem only the integral 
powers are involved.) In replacing (38) by (40) we are ignoring v?, i.e. terms of order f-*+», 
If we are content, then, to find v,(c) correct to the next order f-*+» we shall be committing 
no error in using (40). Now the second integral, J,, in (40), which involves v,(c) linearly, is 
clearly of order f~*+» and hence the replacement of it by the approximation used in (41) 
introduces an error of higher order than f—*+», To order f—*+» equation (41) is still equivalent 
to the original integral equation (38). Hence (42) will give a correction to v(c) of order 
f-**», the error at this stage now becoming of order f—’+®, The iterative process, then, 
corresponds to finding corrective terms of successive orders in 1/f. 

To make the transition finally to an algebraic form we proceed to express J, in (42) itself 
as an expansion in powers of 1/f. The integral of any expression g(M,, M,) over the distribu- 
tion of M, and M, may be expressed formally as follows 


o [ocan, 2) pi) (Mh) dt al, 


= | fen 8404-024 gay, 29) 2(D,) PM) aM, AM (43) 
where it is understood that the exponential is to be expanded in a power series in 0 and that 


ost 
aa) = [5 alwr)| (44) 


We are simply expanding g(M,, M,) formally in a Taylor Series about the point (1, 1). 
Now (43) can be integrated out with respect to M, and MM, to yield finally 


G = Og(w,, w.), (45) 


where 0 = I { 1 -=" exp (— a0) 


1S exp |? +40 +257 +eto| 


e (408 1/8 
- 46 
14+ ES +E + 3(24 a) | +ete (46) 
If we write ©, for the expansion (46) carried as far as terms of order f-*+”, then 
Q,-409(W1, We) will be equal to G to order f+» (provided that the differentiations (44) do 
not produce of their own accord any powers of f greater than zero). In particular therefore 
we have to order f-*+» 
“ mn wae.) oe 47 
y= in| Voory + (1 —)] o( I. (47) 
If we substitute this in equation (42) we shall therefore have an expression for the correc- 
tion v, correct to order f+», To the order concerned this can be simplified by making use 
of the fact that v, differs from £ by something of the order 1/f. Hence to order f+” we can 
write (42) as 


NG”) = NE)- Ory {Voor + wlio). a8) 
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Successive applications of this equation lead to the series solution. Thus, for example, 
if r = 0 we can start with the large sample approximation v,(c) = £ and (48) gives 


' _wey_l1.(4.2 L 49 
WG) oy) = N@)—(1+ (3+3)| NEE yey +091 —y)}- (49) 

Carrying out the differential operations this leads to 
vy) =hE(1 +2) (4 Com. (50) 


Our first correction to the large sample approximation is therefore 


c2 





—)2 
nfo) = +E) (F457, (51) 
and the resulting second approximation is 
we) = E+ 26409 [F OO, (52) 


This second approximation may now be taken as our new »v,(c) and be substituted in (48), 
putting r = 1. This produces (Welch, 1947) the next corrective term 
(1—c)? 


ce (1—c)8 


— 3, (15E + 32E3 + 9€8) (5 ra ak (53) 


c2 


fi 








v,(c) = — (1 +2 





Two further corrective terms are given by Alice A. Aspin (1948). 


8. SERIES SOLUTION WHEN f/f, =f, = 20 


The explicit expressions for the corrective terms given in the preceding section will not, of 
course, have the same numerical values as those of the corrective terms given by the method 
described earlier in the paper. But sufficient has been said about orders of magnitude to 
indicate that they should exhibit the same general sort of behaviour. It will be of interest, 
therefore, to see what the series leads to in the special case f, = f, = 20 which has been 
discussed at length earlier. Taking P = 0-95 (i.e. § = 1-64485), we find for the successive 
series corrections the values shown in Table 10. 

Table 10 may be compared directly with the upper half of Table 9. We do not now possess 
the values of Pr {v < v(c)} at each stage as we did in the lower half of Table 9. The general 
parallelism between such figures as are given, however, suffices to show that the series 
method is doing essentially the same thing as the other method, namely, at each stage 
bringing Pr {v < v(c)} closer to 0-95. The final approximation given in Table 10 is unlikely 
to be in error more than one unit in the last figure shown, and the corresponding 


Pr {v<v(c)} 


is unlikely to differ by more than 0-00001 from 0-95000, whatever the true y may chance 
to be. 
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Table 10. Series calculations for f, =f,= 20 (P =0-95) 
c 0 or 1-0 | 0-1 or 0-9| 0-2 or 0-8| 0-3 or 0-7 0-4 or 0-6 0-5 
Initial approx. to v(c) 1-6449 1-6449 1-6449 1-6449 1-6449 1-6449 
lst correction to v(c) 0:0762 0-0625 0-0518 0-0442 0-0396 0-0381 
2nd approx. to v(c) 1-7211 1-7073 1-6967 1-6890 1-6845 1-6829 
2nd correction to v(c) 0-0035 0-0031 0-0019 0-0004 — 0-0006 — 0-0010 
3rd approx. to v(c) 1-7246 1-7105 1-6985 1-6895 1-6838 1-6819 
3rd correction to v(c) 0-0001 0:0002 0-0002 — 0-0000 —0-0003 — 0-0004 
4th approx. to v(c) 1-7247 1-7107 1-6987 1-6895 1-6836 1-6816 
4th correction to v(c) 0-0000 0-0000 0-0000 0-0000 0-0000 —0-0001 
5th approx. to v(c) | 17247 1-7107 1-6987 1-6895 1-6835 1-6815 


























9. FURTHER DISCUSSION 


The foregoing comparisons have underlined the iterative nature of the series solution. In 
the case which we have exemplified, viz. f, = f, = 20, the final v(c), which includes terms of 
order f—*, was seen to give Pr {v < v(c)} = 0-95000 with perhaps an error of 1 unit in the fifth 
place. The successive inclusion of terms of orders f°, f-1, f-*, f-$ and f—* represents successive 
stages in the progress of Pr {v<v(c)} towards this goal. It cannot be assumed, however, 
that such iteration towards a result of specified accuracy will take place whatever f, and f, 
may be. One’s expectation that the method williterate rapidly (or, perhaps, will even iterate 
at all) to the required result naturally diminishes as f, and f, diminish. 

Some consideration of the point at which the series ceases to be useful has been given by 
Aspin (1948) and by Welch (cf. Aspin, 1949, Appendix). The conclusions to be drawn from 
their work differ somewhat according to where the emphasis is placed. They depend on 
whether the problem is regarded as that of obtaining v(c) itself to a certain prescribed 
accuracy or whether it is regarded as that of satisfying Pr {v < v(c)} = P to a certain degree 
of accuracy. In the tabulation so far carried out (Aspin, 1949), the general aim was to 
tabulate v(c) correct to two decimal places throughout. It appeared then that to attain this 
result with the series for the case P = 0-95, for instance, it would be inadvisable to let either 
f, or f, fall below 6. This limitation was not imposed by the fact that the series had only 
been worked out to terms of order f-*. It could be seen from the behaviour of the terms 
already known that, however far the series were carried it was unlikely to provide in general 
stable values of v(c) to more than two decimal places when either f, or f, was less than 6. 

Turning now to the other way of regarding the problem, direct calculation shows that the 
values of Pr {v < v(c)} obtained at f, =f, = 6 by using the two-decimal v(c), never differ 
from 0-9500 by more than two units in the fourth place, whatever y. It is conceivable that 
for practical purposes one would be content with a solution solving our basic equation less 
accurately than this. It might be considered sufficient, for instance, to make 


Pr {v < v(c)} = 0-950 


to three decimal places only. If this were the case then. undoubtedly a solution could be 
obtained from the series for some values of f, and f, lower than 6. The series cut off at some 
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point (say after the f-* or f-* terms) would provide a v(c) which could, if we wished, be 
written down to two decimal places and which would have the property that 
Pr {v < v(c)} = 0-950 

to three decimals. This v(c), however, although written down to two places, could not be 
said to be correct to two places in the sense that it was unique. For carrying the series to 
more terms might give another v(c) differing in the second decimal but yet still satisfying 
Pr {v < v(c)} = 0-950 to three decimals. It is debatable whether in such circumstances it 
would be worth while attempting in the table to give v(c) to more than one place. 

From the practical point of view some of the considerations outlined above may seem 
somewhat unreal. With very small f, and f, one is perhaps not likely to worry much in any 
practical circumstances about anything after the first place in v(c). Other considerations, 
however, affect the tabulator, who may feel that a table with so few figures looks rather 
thin. At all events it seems worth while to explore what results can be obtained with other 
iterative procedures. The numerical method which was described at the beginning of this 
paper is, as we have shown, very much akin to the series method and therefore, perhaps, 
one should not expect very much advance to be made by using it. There are, however, 
various modifications which can be made of the numerical method as we have described it. 
These modifications seem to offer the possibility of stronger iteration. Until they have been 
tried out in some detail it would seem to us rather premature to attempt at the moment to 
predict what further progress can be made on these lines in extending Mrs Aspin’s two- 
decimal table of v(c) to values of f, and f, lower than those already given. 


10. SumMaRy 


The connexion has been shown between two methods of calculating critical values used in 
the problem of comparing two mean values. The methods are: (i) a predominantly numerical 
method and (ii) a method involving first the expression of the critical values in a series of 
groups of algebraic.terms of different orders. This latter method has been already used in 
the computation of tables. 

The close connexion between the two methods helps to emphasize what the series method 
is doing. A particular case (viz. f, = f, = 20) is discussed at some length, the important 
comparisons being between the figures given in Tables 9 and 10. 
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SOME FURTHER RESULTS IN THE THEORY OF 
PEDESTRIANS AND ROAD TRAFFIC 


By ALAN J. MAYNE 


1. INTRODUCTION AND SUMMARY 


Tanner (1951) has considered several statistical problems about the passage of pedestrians 
across a road, on the assumption that vehicles and pedestrians arrive at random. Here! 
his main results are generalized to the case where the time intervals between successive 
arrivals have a given distribution, any two such intervals being independently distributed. 
Tanner’s results follow for the special case when the interval distributions are negative 
exponential, which occurs when there is a random flow of traffic. The size of groups of 
pedestrians on an island between two lanes of traffic is also considered. The effect of the 
presence of islands on pedestrian delay is discussed, and it is shown that, under certain 
conditions, the ‘efficiency’ in two specially defined senses can be multiplied by at least r?, 
by the introduction of (r—1) islands suitably spaced in the middle of the road. Finally, 
the results are given of a further examination of some empirical traffic data, which supple- 
ments the work of Adams (1936, 1948). 


2. DETERMINATION OF THE DISTRIBUTION OF PEDESTRIAN DELAY 
Suppose that there is a single lane of traffic, and that a pedestrian is able to cross, at any 
given instant, if no vehicle is due to arrive less than time J after that instant. Ift,, t,, ...,t,, ... 
are the arrival times of vehicles at the crossing-point, then it wiil be assumed that (f,—t,), ..., 
(t, —t,-1) --. are statistically independent, and that they are all distributed as 
x(u)=dX(u) (O<u<co; X(0)=0). (1) 
Let 7' be the delay to the pedestrian before crossing is possible. Let the probability that 
this delay lies between 7 and (7'+dT7') be 
f(T)dT=dF(T) (T>0), (2) 
and the probability of zero delay be F(0). 
In order to write the expression for F(7') in a compact form, and in order to simplify its 
derivation, introduce the following notation: 


I I , 
hit; =i. e* x(v +t) dv =|. ed, X(v +t), 


k(t; 8) = ) ; e- 2(y +t) dv= | ed, X(0+1), 


4 
h(s)=h(0; 8), hi%(s) = = h(s)| 


His) =K(0; 8), Be) = k(e)} (i = 1,2,...),f (3) 
h=h(0), h=h0) 


k=k(0), M=k0) I 





as i 
I) =)’ 





Mean m= —[K +h] = i) * vd X(v). 
0 
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THEOREM 1. (1) The probability of zero delay is 


F(0) = -= (Ik+ i). (4) 
(2) The Laplace transform of the distribution of pedestrian delay is 
Le, T3f(I)}e [eT aP(T) = F(0) + [1 —ke-Mj(e)] 


= — {el — Is —ke-!*j(s)}— ks}. (5) 
(3) The mean delay is 
BUD) = (0% — [21 — HO] + 2424-3, (6) 


(4) The variance of the delay is 


1 Pk — [3h]? — 3h +h) 


var (2) = 3m \ + GhOLAOI — hi] kA — Bho a] —— "7 


Proof of Theorem 1. In order to calculate F(T’), it is convenient to find, first, the distribu- 
tion of the delay, when the interval between the time of arrival of the pedestrian and the 
instant at which the vehicle passes the crossing-point has a known value ¢. For any given t, 


- f(T | t)aT =dy F(T | t) (8) 
be the probability that the delay before crossing is possible lies between 7' and (7'+4dT)); 


let F(0, | t) be the probability that this delay is zero. 
In practice, however, ¢ is not known, and is a random variable. Let its distribution be 


f(t) =d®(t). (9) 
Then F(T) = ) “F(D | t)d0(). (10) 


The proof of Theorem 1 proceeds by finding expressions for ®(¢) and F(T | t), whose values 
are given in two lemmas, and combining these expressions in accordance with equation (10). 
The value so obtained is then rearranged, so as to yield parts (1) and (2) of the Theorem; 
parts (3) and (4) are derived directly from part (2). 


Lemma 1. P(t) dt=dV(t) = <1 — X(t)) dt. (11) 


Proof of Lemma 1. Consider the interval between the vehicle-passage times preceding 
and following the arrival of the pedestrian at the crossing-point. Let the probability that 
this interval lies in (wu, w+du) be y(u)du=dY(u). (12) 


To calculate Y(u), consider an infinitely long series of successive vehicle-intervals. 
A proportion dX(u) of the intervals of this series have length between u and (u+du), so 
that a proportion m—'udX(u) of the length of the series is composed of intervals of length 
between u and (u +du). As the arrival time of the pedestrian may be considered to be random 
with respect to the series of intervals between vehicle-passages, the probability of arriving 
during an interval of length between wu and (u+duw) is 


dY(u) = (const.) x [dX(u)] xu = — wdX(u), (13) 


f 


since i const. udX(u) = 1. 
0 
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Since the arbitrary point lies in an interval of length w, and is distributed at random in 
that interval, then the probability that it lies at distance (¢, + dt). from any given end of that 


interval, given u, is udt, if 0<t<u; 


0, if t>u. (14) 
Then d(t) = m-dt i ” dX(u) = m—[1 — X(o)] dt, 
t 
which is the requred result. 
Lemma 2. L{e,T; f(T | t}= ) ” eT dp F(T | t) 
0 
p. khit; 8) j(8) 
= F0|)+ Foxy (15) 


Proof of Lemma 2. Suppose that a pedestrian arrives at time ¢ after the last vehicle-passage. 
Then, if w is the difference between the arrival time of the next vehicle to pass after the 
arrival of the pedestrian, and the arrival time of the pedestrian, its distribution is 


d,, X(u+t) 
1—X(t) ° 


The probability that crossing is immediately possible is equal to the probability that the 
next vehicle will arrive at a time more than J later than the pedestrian’s arrival, i.e. more 
than (¢+J) after the passage of the last vehicle. The required probability is 


1—X(t+J) 
1-X(@) 
Next, consider what happens if crossing is not immediately possible. 


If 7 is between 0 and I, then the crossing may occur immediately after the next vehicle- 
passage; this event has probability 


F(0|t) = (16) 


kd X(T +t) 
1—X(t) ’ 
since F(0| 0) =k. 
If the next vehicle-passage takes time 7' > I, the pedestrian could have crossed at once, which 
leads to a contradiction, Hence 7' <I for the crossing to be possible immediately after the 
next vehicle-passage. 

If T is between 0 and J, the only other way for the crossing to occur is for there to be a 
further delay after the arrival of the next vehicle. At this moment, the situation is identical 
with the initial situation when ¢ equals 0. This follows from the original assumptions of the 
problem. Thus this event has probability 


T- 
ar{ f(T-u | 0) d,, X(u+t) 
J0 
1—X(t) 
If 7 is greater than J, the probability is calculated analogously and is 





I 
ar| f(T —u| 0)d,X(u+t) 
0 
1— X(t) 
+ This proof is similar to the argument of Malmquist (1947). 
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In consequence, f(T' | t) satisfies the equations 
1-X(HIP(T | t) = kel +1)+ [fT —w |0)d,X(u+t), if oe 
(17) 


X(T |t) = I, f(T —u|0)d,X(u+t), if T>I. 
Let e(T)=1, if 0<T<I; 0 if Toi. 
Then (17) can be written as 
(1—X()] f(T | t) = ka(T +t) e(T) +[" fr—a| 0) z(u + 7’) e(u) du, 
if 7’ >0. In consequence, 


L{e,2;f(2 | hm |” e+? dg FEE | 


I T- 
7 erat +tar+ |” earl f(T —u| 0) e(u)d, X(u+t) 
_ J0+ 0+ 0 
a 1— X(t) 
I co co 
e| eT x(T +t) dT +f e(u)d,, X(w+ of e~%u+”) F(y | 0) dv 
— 10+ 0+ O+ 
1— X(t) 
putting v = 7'—w and changing the order of integration in the double integral, 








I ) cD 
k ed, X(T +t) + i) e-e(u)d, X(u +t) i} eT dy F(T | 0) 
— 10+ 0+ 0+ 


1-X() : . 





replacing v by 7’ in the double integral. Thus 
L*{s, 7; f(T | 0)} = kh(s) j(), (19) 
putting ¢ = 0 in (18) and using (3). Also 
L*{s,T; f(T | t)} = 
applying (19) to (18) and again using (3), so that 
Ls, 7; f(T | t)} = F(0|t)+L*{s,7; f(T | t)}, 
which, by (20), yields Lemma 2. 
Completion of the proof of Theorem 1. By (10), 


L{e, 7; f(7)} = I % L{e,T; f(T | t);d@(t) 


kh(t; 8) j(8) 
1—X(t) ’ 





(20) 


‘ i) ; F(0|t)d@(t) + bj(s) I : [1- X(t) A(t; 8) dot) 


0 I 
= F(0) +m-hj(e)| at e~*" dX (v+t), (21) 
0 Jo 
by applying Lemmas 1 and 2. Now 


ro) co rs) —Z 
F(0) = m- : a{” aX() =m f ax)[” dt 
= m- " (0-1) aX (0) = m-{ ~~ IK, 


by (3), from which part (1) of the theorem follows immediately. 








9) 


D) 





eee 
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ce) I Co t+I 
Again, { ar{ ed X(v+t) = f ar| eu) dX (u) 
0 Jo . o Jt 
I 0 u 
‘ ax(u){ ou) dt + ) ax(w){ eau dt 
0 0 I -I 


= gt ‘ (1—e-) dX(u) +s é (1—e-7*)dX(u) 
0 I 
= s[1—A(s)—ke-?*] by (8). (22) 


By applying (22) to (21), the first form of part (2) of the theorem follows immediately. The 
second form of it is obtained by applying part (1) to the first form. 
Using the fact that 


j(e) = le-= (i!) niet| ‘a (23) 


L{s, 7; f(7)} can be expanded in a series of ascending powers of s. The coefficient of (—s)" 
gives the rth moment of the distribution of 7 multiplied by 1/r!. By calculating these 
coefficients for r = 1 and 2, parts (3) and (4), respectively, of the theorem can be derived 
directly. Other statistics of the distribution, based on the moments, can be determined 
similarly. 

The Laplace transform of f(7'’) can most conveniently be inverted by expressing it in 
partial fractions. It can then be shown that f(7') can be expanded as a series of negative 
exponential terms in 7', multiplied by factors of the form («cosy7'+fsinyT), where 
a, £, y are constants. These latter factors may sometimes be equal to one. 

This follows because ale) 


L(s,u; x(u)) = X(0) +566)" 


where a(s) is analytic, b(s) is of form Il (s—c,)~, and a(s), b(s) have no roots in common. 
i=1 
If all the roots c,; of b(s) are simple (i.e. 7; = 1 for all ¢), then 
a(s)_ 2% ae) 
b(s) =, b’(c,) (s—¢)’ 
whose inverse Laplace transform is a series of terms of the required form. 
The first few terms of this series, or even the first term by itself, can usefully be taken as 
an asymptotic expansion for large enough 7’. Also, the values of 7’, such that F(T) = p, 


can be investigated. Full details are given in Mayne (1951). 
For the special case of random flow, considered by Tanner (1951), 


(24) 


a(u) = Ne“, X(u) = 1—e-™, (25) 
where N is the vehicle flow, the mean number of vehicle-arrivals per unit time. Write 
q=NI, a=qe-*. 


THEOREM 2. If the traffic flow is random, 
(1) The Laplace transform of the distribution of delay is 


-NI 
Lee, Tf) = (26) 
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(2) The distribution of the delay is given by the following expressions: 
F(0) = el =e-4, 
f(T) =NeMNe=al=A, if 0<T<I, (27) 
f(T) =A (5 (—A)é[(T—il)*—e-@ (TP —¢ 4 11] + (rn!) ( - ay (P-rIy}, 


if rl<T<(r+1)J. 
(3) The mean delay is 





nT) = a Lh ‘ at aug (2s) 


(4) The variance of the delay is 


e=NI—-2NIeNI—1 (e@— 2g et—1) J? 


var (T) = 7 Fr (29) 





Proof. Theorem 2 is derived from Theorem 1 by straightforward calculation.t 
Carrying out the partial fractions expansion described above, it is found that, for large 
enough 7’, and using (24), we (q—q)ete-NT 
(li-q’)l ’ 


where N’ = q’J-1, and q’ is that real root of ze~* = qge~*, which is not equal to g, except when 
q=l=q. 
It follows from (29) that the median m,(7’) = 0, if F(0) >}, ie. 





(30) 





q<log 20-6931. (31) 
If e-*< , but e-“(1+ 9) >}, ie. 0-6931 <q < 1-6784, then 
m,(T) = N-\(fet— 1). (32) 
I al 
For ter q, m(T)=— {lo E ai- |, 33 


a result derived directly from the asymptotic formula (30). 


3. OPTIMUM POSITIONS OF ISLANDS TO OBTAIN MINIMUM MEAN DELAY 


Consider a road with r lanes of traffic, in each of which the traffic flow is random. Let the 
flow be N, in the ith lane. At first, suppose that there is no island and that the safe-crossing 


time is J. Let N = > N, (N; > 0). Then, since the traffic flow in all the lanes is random, the 
i=1 


i NI_ NI — 
mean delay is e ra 1 (34) 


Now suppose that (r—1) islands are placed between the lanes, such that the respective 


T = 


safe-crossing times are J,,..., [,, where I = z I,. These times are supposed proportional to 
i=1 


the relative road widths, so that siting can be effected after the optimum J, ..., J are chosen. 
The new mean delay is rig eNis—NIg—1 


i=1 N; 


+ The results of Theorem 2 were derived by Tanner (1951), who proved them by a different method. 
As Tanner points out on p. 384 of his paper, Garwood (1939) obtained a formula similar to (27), while 


considering a problem closely related to that of pedestrian delay. Equation (28) was first obtained by 
Adams (1936). 


(35) 











whe 


isl: 
ab 


it 


2- 


rdagdeaadcs?:? 


(27) 


(32) 
(33) 
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Lemma 3. The minimum of 7”, for all positive J, ..., J, such that J = z I, is 
i=1 
a  eNI_N*I—-1 
As GH ey 


r -1 
where N* = [= yz] 
i=1 


(36) 


-1 
Proof. Replacing I, by I— >, I,, it follows that 
i=1 


Equating these derivatives to zero, it is found that, for the turning point, 
r-1 
Nh =¥[1-S | = NI, 


so that, in fact, N,I; = N*I. Inserting these values of J, into 7’, the value of T’* is obtained. 
This value is in fact the true minimum of 7”, since the values of 
or 
ol, ol; 
are, for all real, finite, J, ..., 1, the coefficients of a positive-definite quadratic form. 


Lemma 4, The minimum value of NV N*-', for all positive N,,..., N, such that N = z N;; 
is 7°. i=1 


Proof. By Schwartz’s inequality, 
r r r 2 
Wes = 5 (vy S wriyt| & pave] =*, 
i=1 i=1 i=1 


which is the required result, since equality holds for N, = Nr-1 (¢ = 1 to r). 

Applying Lemmas 3 and 4, it is clear that the mean delay, for total flow N, with (r—1) 
islands present, is at most equal to the mean delay, for total flow Nr-*, with the islands 
absent. 

Thus, for a given mean delay, the flow, with islands present, and suitably spaced, is at least 
r? times the flow, without islands. 
eNI_NI-1 NI? N?I8 Net 
ee ee ee 
it follows that T(cN) >cT(N), where c> 1. 

In consequence, for a given flow along the road as a whole, it follows from equations (34), (36) 
and (37) that the mean delay is reduced by more than r? times by introducing (r — 1) well-placed 
islands. As the traffic becomes really heavy, this reduction is much more than r°. 

These results hold only if the lanes between the islands are sufficiently wide to allow free 
passage of the vehicles in them, because, in a crowded lane, the negative exponential dis- 
tribution of vehicle-intervals ceases to hold. If the densities in two different lanes are 
widely different, then, at the optimum positions derived from the assumptions used here, 
the islands are so placed that the denser lane becomes too narrow for use in practice. Thus, 
unless the densities in all lanes are roughly equal, the actual optimum positions of the islands 
will be more evenly spaced than the theoretical positions, and the actual gain in efficiency 
will not be so great, as soon as the traffic flow becomes fairly large. However, it is not yet 
known how considerable is the consequent deviation from optimum efficiency. 





= N,eNrlr + 8,,.N; eNi4 


Since T(N) = +... (37) 
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For the general case, when the traffic flow is not random, a theorem corresponding to the 
‘r? rule’ has not yet been derived, and, here again, it is not known how close to r? the actual 
gain in efficiency would be. 

In practice, r is usually equal to 2, corresponding to the presence of a single island. The 
cases where r+ 2 are not yet of much importance. 


4. PEDESTRIAN QUEUING PROBLEMS 


Using Tanner’s notation, let a be the number of pedestrians waiting to cross when a random 
vehicle passes the crossing-point: 

Let # be the number of pedestrians crossing immediately behind a random vehicle. 

Let y be the size of a random group of pedestrians crossing. 

Let 3 be the number of pedestrians waiting at a random time. 

Let € be the size of group with which a random pedestrian crosses. 

Let 7 be the number of pedestrians, at the crossing point, waiting to cross just before 
a random vehicle-passage at which immediate crossing is possible. 

Let A,, B,, C,, D,, H,, H,, respectively, be the probabilities that «, 2, y, 3, ¢, 7 have value r. 

Let A(z), B(z), C(z), D(z), H(z), H(z) be the corresponding probability generating functions, 
ie. A(z) = 4 A,#, ete.t 

ro 


Let successive intervals between pedestrians be independently distributed, and let the 
probability that a random interval has length between u and (w+du) be g(w)du=dG(u). 


Let i) " udG(u) = M. Let Q,(v; t) be the probability that exactly r pedestrians arrive in an 
0. 
interval of length r, whose beginning is at time ¢ after the arrival of the previous pedestrian. 


Let Q(z; v; t) = D4 Q(v, t) 2. (38) 
Let Q(z; v) be the average of Q(z; v; t) over t, i.e. 

Qe; v= |” Qe: oN aH), (39) 
where ¥’(t) =d'¥'(t) is the probability that ¢ lies in (t, t+ dt), whose value is given by an obvious 


modification of Lemma 1. Q(z; v) can be considered as the probability generating function 
for the number of pedestrians arriving in a random interval of length v. 


THEOREM 3. 
(1) A(z) = I Q(z; 1+v)d, F(v| 0). (40) 
(2) Bee) = kl” Qe; 1+ v)d,F(0| 0)+h = kG) +h. (41) 


kB’ (1)z+A[B(z) — B(0)]} 


(3) OC) = FRa)+h- BO) () 





+ The corresponding moment-generating functions are A(e*), etc. 
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to the (4) D(z) = m-4{ — 1044 A Q(z; v) do—1| 
actual 0 
I u oe) 
|. The +[ ax(u)|" dv . Q(z; u—v+1+w)d,F(w| 0) ‘ (43) 
(5) E(z) = 2C"(z)/C’(1) = 2 kB’(1) + hB’(z)}/B'(1). (44) 
|) He) =[" Qe: 1+0)4,F(0| 0) = AC), (45) 
ndom _ where the value of Q(z; v), as defined by (39), is given by Lemma 5. 
Lemma 5. Let y= f e acu)” 
a (46) 
and T(s; t) =| et“) dG(u). 
t 
efore Then the Laplace transform of Q(z; v) is 
1 fefl-—G 1—T(s; 
Jue r. Ls, v; Q(z; pel. e~" Q(z; v) dv = ml, ‘er 5 ae. (47) 
tions, Proof of Lemma 5. 
Qari) = 1” dau), 
ott 
t thi o+t 
Sy Q,(0; ) = 71)" Qa(o—u4+t; aga. 
r ott r-1 
nan _—‘Thus EQ; = Qi +70" 2 E AQ (o-u+ 6, dew), 
Tian. so that, if > z'Q,(v; t) converges to some function Q(z; v; t), then 
i=0 
(38) Qe; 1) = Qolvs N+ yO” 20a; vu +4; Naam, 
In consequence, 
ee) ce) cO wot+t 
} e~8" Q(z; v; t) dv={ e-*” Q,(v; t) dv+2y(t)| e~** dv Q(z; v—ut+t; t)dG(u) 
0 0° 0 t 
= } e~8* Q,(v; t)dv+ zv(t)| e--9ag(u)| e-8* Q(z; a; t) da. 
, 0 t 0 
rious ” 
tion Thus L{s,v; Q(z; v; n= e-** Q(z; v; t)dv 
0 
[ e~8” Q,(v; t) dv 
(40) 1- et)” et dG(u) 
> i) co u-t 
(41) Now i) . e~ do [" actu) =|) aau)|’ e~** dv 
= 8~ = _ —u) 
im 8 I, (1—e%—)d@(u) (s+0), 
so that I e-*° Q),(v; t)dv = nn] e-** dv 4 dG(u) = s [1 —T'(s; #)). 
0 0 v+t 
Biometrika 41 25 














384 | Theory of pedestrians and road traffic 


In consequence, L{s, v; Q(z; v; t)} = imate Ay (48) 
By (39), Lfe,v; Qe; w)} =" Lfe,0; Qe; »; 9} AF), (49) 
and, by an obvious modification of Lemma 1, the distribution of ¢ is 
Y(t)dt=d¥(t) = M| d@(u) = M71 -@@)]. (50) 
t 


The lemma follows immediately, by applying (48) and (50) to (49). 

Proof of Theorem 3. Consider an arbitrary vehicle-passage instant, at time 0, say. Con- 
sider the vehicle intervals in the period (—0o0,0). Let (—v’, —v) be the latest of these in- 
tervals to have length at least J. Then the queue at time 0 consists of those pedestrians who 
arrive during the period (—v—J,0). As v is also equal to the delay to a pedestrian arriving 
at a random vehicle-passage, 


A(z) = i) * Qe; I+0)d,F(o| 0), 


so that part (1) of the theorem has been proved. 

Since this proof is valid, irrespective of whether or not crossing is possible at time 0, 
part (6) of the theorem follows immediately. 

With probability 4, immediate crossing is possible at a random vehicle-passage, in which 
case the contribution to B(z) is H(z). With probability h, immediate crossing is not possible, 
in which case the contribution to B(z) is 1. Thus 

B(z) = kH(z) +h, 
which, by part (6), yields part (2) of the theorem. 

To prove part (4), consider a random time, and let the next vehicle-passage be v ahead, 
and the previous vehicle-passage (wu — v) behind. Then the probability that u lies in (u, u + du) 
and v lies in (v,v+dv) is, by (13) and (14), m-1dX(u) dv, if v<u; 0, if v>u. If v>J, the 
probability-generating function, for given wu, v, is unity. If v<J, u>T/, it is Q(z; J—v). 


If v<JI, u<I, itis eo 
i) Q(z; u—v + I+w)d,, F(w| 0), 
0 
as can be seen by using an argument similar to that used in the proof of Part (1). Thus 
co cD I 
mD(2) = dX(u) i}  de+ i} dX(u) i} Q(z; 1—v) dv 
I I I 0 
I ) 
+f aX(u){ "du Q(z; u—v + I+w)d,, F(w | 0), 
0 0 Jo 
from which part (4) of the theorem follows directly. 
To prove part (3), use the arguments of Tanner (1951, p. 387), which, for the general case, 
give C(z) = x[B(z) — B(0)] + nz, 
where « and yu are given by 


eres _ _«B(1) 
1=«{1-B(0)]+y4, h= Ben 
This, after a little calculation, gives the required result. 


As a proportion C, of groups cross with r pedestrians in them, it follows that a proportion 





rC,]| > rC, of pedestrians cross in groups of size r, which leads almost immediately to part (5) 
r=1 


of the theorem. 
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Theorem 3 holds for very general conditions, but two special cases are worth mentioning, 
although the actual results for them will not be stated here. First, the pedestrians may 
arrive at random, i.e. g(u) = ne~™. This case is considered by Mayne (1951, § 3), though not 
in much detail. Secondly, the vehicles may also arrive at random, i.e. x(u) = N e-. This 
case is discussed in considerable detail by Tanner (1951, §3). The particular results for 
these cases are obtained by inserting the appropriate functions in the formulae of Theorem 3. 

In his formulae, which were calculated only for pedestrians arriving singly, Tanner 
introduces the quantity v(z) = p(e'—1) = p(z—1). Using the time-scale J = 1, suppose 
that p, groups of r pedestrians arrive per unit time on the average (r > 0), instead of the 
case where r takes only the value unity. Then it can be shown that these formulae still hold, 


where, now, wo 
(2) = & ple’). (61) 


Thus z, in the original formulae, is here to be replaced by 
] eo ao 
[2 +> & Prl2— | (p — Pr) 
Pr=1 r=1 
Let y(z) = v(z)J—1. Thus, for pedestrians arriving singly, ~(z) = n(z—1), since p = nl, 
and, if n, pedestrians arrive per unit time, p,=n,J,2 = > n,, 80 that 


r=1 


p(2) = + n, (ef ~ 1). (52) 


z=uk 

For g(u) = ne~™, it is found that y(t) = e“, I'(s; t) = n(s+n)—. Applying Lemma 5, 
L(s,v; Q(8; v)) = [s—n(z—1)]}> 

so that Q(s; v) = er@-De = ener, (53) 

Equation (53) still holds when (z) is given by the general formula (52). 


Thus, when pedestrians, or groups of pedestrians, reach the crossing-point in a random 
flow, the results of Theorem 3 can be simplified as follows, using (53). 


THEOREM 4. If the pedestrians arrive, so that groups of them of size r reach the crossing- 
point in a random flow at the rate of n, per unit time (r a positive integer), then, writing 
HM’ for p(z), u'(2), 








(1) A(z) = kel*j(—p), (54) 
(5) Biz) = el*j(—) +h, (55) 
_p'(1) [Tk 1) 2 + hifet# j( —p) —e-™4j(n)} 
8) Ce) = (i) k—hO]+ A ke G(my] lad 
(4) Die) = {— mil + hletaj( — a) (Hn) —h} + "Iu — 1}, (57) 
fle! (1) (Te — WO] + kip’ et (Ij —n) —3"(—w)] 
(8) Ee) = ee a eee, (58) 
(6) H(z) = ketj(—p) = Ale). (59) 


Theorem 4 is proved directly by applying (53) to Theorem 3.¢ An immediate consequence 
of it is 

t Equations (3-1-6) to (3-1-8), (3-1-12), (3-2-1), (3-2-2) and (3-2-4) to (3-2-7) in Mayne (1951) are in- 
correct. The correct forms of equations (3-1-12), (3-2-1), (3-2-2) and (3-2-6) are given in equations (47), 
(59), (55) and (65) of this paper, respectively. 


25-2 
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THEOREM 5. 

(1) Mean (2) = u’(1)(7—h%-], (60) 
(2) Mean (8) = p’(1)(Ik—h™], (61) 

i (1) [Tk — 10 

(8) Mean (y) = Fei) (Tk — AO) + hl —be-*ay]} 0 
(4) Mean (8) =4© pre — 270% + 10 4 250244), (63) 
(5) Mean (e) = 1+ “tl + EA v. tk — 270 + 1 4 2400449), (64) 
(6) Mean (7) = w’(1)[1—Ak). (65) 


5. DETERMINATION OF THE GROUP-SIZE DISTRIBUTION ON 
AN ISLAND BETWEEN TWO LANES OF TRAFFIC 


For simplicity, suppose that all pedestrians using the island are crossing in a single direc- 
tion. (If crossing is possible in both directions, the calculations necessary are much more 
complicated.) Let the distributions of successive vehicle-intervals in the first, second lanes, 
respectively, to be crossed by the pedestrians, be denoted by dX,(u), dX,(u). Let functions 


be defined in terms of X,(u), X,(w), analogously to those which are defined in terms of X(u), 
in § 2. 


This problem has not been treated in as great detail as the case when the pedestrians are 


on a pavement, at the edge of the road, but Mayne (1951, § 4) obtained formulae for H,,(z), 
the analogue of H(z), and B,(z), the analogue of B(z). Note that 


B,(z) = ky H(z) + he. (66) 
His result for the most general case is too complicated to give here, but the result for the 
special case when the flow in lane 1 is random is stated without proof, as follows. 
THEOREM 6. Ai,(z) =|" Hi(y; z)dF,(y — I), (67) 
0 
where 
H,(y; 2) = {N,[N en: — p}} 
x Mut (Ni—?) exp [T(u—M) + ny] + exp [(n—-M)(L,+y)] 
y 
+4 é {N, — (N, — 4) exp [u(y +L —u)] + (NM, — 2) e4" — NJ exp [(u— ™,) (y—u)]} dF, (u). 
Mayne (1951) also showed that, for this case, 


Mean (7;) = y’(1) [1,— AP kz"), (68) 
which, apart from the suffix 2, is the same as (65). 


No correspondingly simple results are obtainable for the variance or the other simple 
statistics, even when the flow in lane 2 is also random.t 


+ These results hold under the assumption that pedestrians arrive at random, either singly or in 
groups of various sizes, so that yu is given by (51). 
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.6. AN EXAMINATION OF SOME EMPIRICAL TRAFFIC DATA 


Adams (1936, 1948) provided a considerable amount of data on actual vehicle-passage times, 
measured by himself, C. C. Judson and D. A. de C. Bellamy, and carried out two statistical 
tests on it. The object of these tests was to find out whether the flow of traffic in practice 
was random, and also to determine the conditions under which marked departures from 
randomness occurred. Here, further statistical tests with the same object are summarized 
and their most important results are given briefly. All of them can, if desired, be modified 
so as to test any other given law of traffic flow, in which vehicle-intervals are independently 
distributed and have the same distribution. The third of these new tests is designed to test 
the general hypothesis that successive vehicle-intervals are independently distributed. 
For further details, especially for the complete tables of results, see Mayne (1951). For these 
additional tests, the eleven lanes considered by Adams were used; however, a twelfth lane 
was added, which had been observed since his report was written. The flows varied from 70 
to 710 vehicles per hour. 

In his first type of test, Adams compared the observed distributions with those calculated 
on the assumptions of randomness, for the number of vehicle-intervals larger than t, for 
various ¢, and found that they agreed closely. 

In his second type of test, the period of observation was divided into successive intervals 
of fixed size, in practice 10 or 30sec., and then a count was mad* of the number of these 
intervals with r arrivals (r = 0,1, 2,...). Then, if m is the average number of vehicles in the 
given interval time, the probability of r vehicles arriving during an arbitrary interval is 
e-™ m’/r!, if the traffic stream is in fact random. Thus the expected numbers of intervals 
containing r arrivals can be compared with the actual numbers, so that a y?-test can be 
applied, or the comparison judged by direct inspection (if agreement is close enough). 
Adams plotted these observed and expected numbers for three of the traffic lanes considered. 
Refer to Adams’s x? test as Test 1. Some additional, new, tests will now be described, which 
have been carried out on the eleven lanes considered by Adams, and on one extra lane. 

In Test 2, the range (0,00) is divided into n ranges R,, (a;_,,@;) (¢ = 1 to n), such that 
a, = 0,a,, = N, where Vis a very large number allowed to tend to infinity. These are assigned 
so that, if the successive vehicle-intervals u are distributed with probability X(u), then the 
probability that an arbitrary interval length belongs to any given R; is 1/n. The numbers 
a, are thus the solutions of the equations 


i) ae) = tpn | em Pt wy: (69) 
0 


Although this method is applicable to general X(w), it is here considered only for 
X(u) =1 = eR, 


as the basic null hypothesis in all these tests is that the traffic flow is random. Here Nis 
taken to be the empirical value of the traffic flow, i.e. it is the number of vehicle-arrivals in 
the period considered, divided by the length of this period. For this case 


a, = —N-log,(1—i/n) (i =1 to n). (70) 


The numbers Y, of vehicle-intervals for the n ranges R, are counted, and compared with the 
theoretical numbers M/n, where M is the total number of vehicle-arrivals. The goodness 
of fit can then be evaluated by a x? test with (n— 2) degrees of freedom. 
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In Test 3 it is determined whether the successive interval lengths are independently dis- 
tributed. The range (0,00) of interval lengths is divided into n ranges R; (a;_,,a;), covering 
the whole of the range, which are assigned so as to have roughly the same number of intervals 
in each. The numbers Y, of intervals in R; are counted. The observed numbers Y,, of interval 
pairs, of which the first is in R; and the second is in 2;, are compared with the corresponding 
numbers M;M,;/M, which are expected on the hypothesis of independence. The goodness 
of fit is evaluated by a x? test with (n— 1)? degrees of freedom. 

In Test 4 it is determined whether the traffic density varies significantly from one part of 
the period considered to another. This period is divided into n equal intervals R,, and the 
number Y, of vehicle-arrivals counted in R; is compared with the corresponding number 
M/n expected on the hypothesis of homogeneity. The goodness of fit is evaluated by a x? 
test with (n — 1) degrees of freedom. 

All the tests gave non-significant results, with the following exceptions (bracketed figures 
give the position of the significance level): 

Test 1. Lane no. 11 (0-02 to 0-05). 

Test 2. Lanes no. 6 (< 0-001), 10 (0-001 to 0-01), 11 (< 0-001). 

Test 3. Lane no. 11 (0-01 to 0-02). 

Test 4. Lanes no. 2 (0-01 to 0-02), 11 (0-02 to 0-05). 

Considering that twelve lanes were used in each test, the results of Tests 1, 3 and 4 do not 
decisively reject the hypothesis of random flow in all the lanes, other than no. 11. However, 
Test 2, which seems much more sensitive than the other tests, gives a deviation from the 
null hypothesis, which is extremely significant for no. 11, and is still very significant for 
nos. 6 and 10. Thus the conclusion is that all lanes probably have random flow, apart from 
nos. 6, 10 and 11. Closer examination of the data suggests that the distribution of intervals 
for these lanes is of form x(u) = Netlgee-N2/e! (¢>0). (71) 
For example, c may be taken as 1 or 2. This formula has in fact been suggested by some 
members of the Road Research Laboratory. The results for no. 11 suggest that, here, the 
successive intervals are not even independently distributed, and it is probable that the high 
density of traffic is here causing serious interference. 

Greenshields (1946) compared the observed curve of X(u) with the theoretical (negative 
exponential) curve for several traffic lanes. For traffic flows over about 300 vehicles per 
hour, he found that the theoretical values were too high for low u, and that, in practice, 
very few values of u were less than 1-36 sec. In two cases there was an extra mode in the tail 
of the curve for x(u), as well as the usual mode at a low or zero value of u. Nevertheless, 
he also concluded that, for flows not too high, the assumption of randomness gives results 
which are accurate to a reasonable approximation. 

I am indebted to the Director and staff of the Road Research Laboratory of the Depart- 
ment of Scientific and Industrial Research for their cooperation in permitting me to read 
two of their reports, Adams (1948) and Tanner (1951) (before its publication), in supplying 
me with data of observations on traffic, and in inviting me to visit the Laboratory itself to 
discuss the problems of road traffic. I am indebted to Mr W. F. Adams for allowing me to 
discuss the empirical data quoted in his papers. I wish to thank Mr D. G. Kendall and 
Mr J. C. Tanner for their extensive advice given to me during my research on road traffic, 
and Mr W. F. Adams, Prof. D. G. Champernowne, Dr F. Garwood, Prof. P. A. P. Moran, 
Mr P. 8S. Neall and the referee for several useful suggestions. 
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BIAS IN THE ESTIMATION OF AUTOCORRELATIONS 


By F. H. C. MARRIOTT, University of Aberdeen 
anp J. A. POPE, Marine Laboratory, Aberdeen 


1. INTRODUCTION 


1-1. In the analysis of. most time series it is customary to estimate the mean and the 
trend by fitting constants and use the residuals for the estimation of autocorrelations. 
Although it is quite generally realized that estimates of autocorrelations obtained in this 
way are liable to bias, the form and full extent of this bias have not been extensively in- 
vestigated. In a recent note (1953) the authors pointed out that serial correlations of 
stationary time series are liable to more serious bias than has commonly been supposed. 
In this paper the bias in serial correlation coefficients derived from certain types of stationary 
series is considered. In subsequent papers it is hoped to investigate in detail the effect of 
different methods of trend removal on particular types of series. 

1-2. The bias in serial correlation coefficients arises from two sources. In the first place, 
if the true mean of the series is known the serial correlations will, in general, be biased except 
when the corresponding autocorrelations are zero, since the serial correlation and the 
estimated variance are not independently distributed except in special cases. The direction 
of this bias appears, in some schemes at any rate, to be towards zero. 

In practice, the mean frequently has to be estimated from the sample and this introduces 
a further bias. This second source of bias, which is present even when the autocorrelation 
is zero, is always negative in a long series, i.e. the expectation of the serial correlation 
calculated using the estimated mean is always algebraically less, nearer to — 1, than the 
expectation when the known true mean is used.t The two sources of bias may reinforce 
each other, or may act in opposite directions; they are not independent and cannot be 
investigated separately. 

1-3. Orcutt (1948) appears to have been the first to describe these two sources of bias 
explicitly. The exact distribution of the serial correlation coefficient (circularly defined) 
for a series of random normal deviates was derived by Anderson (1942), and the bias in the 
first serial correlation coefficient when the mean is estimated shown to be (n—1)-4. Moran 
(1948) showed that the bias in all serial correlations of a random series (not necessarily 
normal) using deviations from the sample mean is (n—1)-! for both circular and non- 
circular definitions. Sastry (1951) investigated the bias in the serial correlations from 
certain non-random series but considered only the second source of bias and in consequence 
under-estimated the total bias. 

1-4. A rough method of removing the bias in estimated autocorrelations has been sug- 
gested by Quenouille (1949). This method consists of calculating the statistic 


R= 2r—$rts), 


+ For, if | p | <1 using the definition of (2-04), the correlation using the estimated mean is of the form 
(A—C/n)/(B—O/n) +O(n-*), where B, C>0O, and | A | <B. This is equal to 
A/B—C(1—A/B)/(Bn) +O(n-), 
which is less than A/B for large values of n. 
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where r is the serial correlation coefficient for the whole series and ,r and ,r are the serial 
correlations of the first and second halves respectively. This procedure reduces the bias in 
Rto order n-*. However, the use of this adjustment inevitably implies some loss of efficiency. 
Probably this is not serious as r and ,r+,r are very highly correlated. In practial cases, 
this method is very useful as it requires no assumption about the nature of the series. 

1-5. The only method of estimating the extent of the bias in serial correlation coeffi- 
cients seems to be by evaluation of the sample moments. In the present paper the bias to 
order n~ in serial correlations is evaluated for two of the simplest types of autocorrelated 
series. The unweighted moving average series x, = €,+€,_, and the Markoff series 


= p%..+6 (|p|<1) 


are considered in some detail, and the theoretical work is supplemented by sampling 
investigations on artificially constructed series. 


2. DEFINITIONS 


2-1. A number of definitions for serial correlation coefficients have been adopted by 
various writers. 

One of these, the circular definition, involves special assumptions, and it will not be 
considered further in this paper. 

When the mean m is known the kth serial correlation coefficient is defined as 


n—-—k 
— X (%—m) (%,4—m) 
t=" , (2-01) 
a x (%,—m)? 
t=1 





When the mean is estimated from the data, three definitions will be considered: 


= et bad Se : a(S x) (= Zs) 


t=1 











“Eats 
mt oh tie ( >» x) 
72) = = t=1 = fe1_/ (2-08) 
nyt a(S *) 
® at Taa t+k~ (n ; as (3 ) (= as] 200) 


2 
n Ph wt n a(S x) 
The first of these definitions requires the calculation of separate estimates of variance 
for the two sets of observations being correlated, and is rather cumbersome to use in 
practice especially when a large number of serial correlations are required. The correction 
for the mean in the numerator of the second definition (which was considered by Sastry) 
is not strictly appropriate, and in sampling investigations carried out by the authors rf?) was 
found to give occasional values considerably discordant with the other definitions, especially 
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in short series. This will obviously happen when the end terms differ appreciably from the 
mean in the same direction. The definition (2-04) employs a sensible correction for the mean 
in the serial covariance and the same estimate of variance, based on the whole series, for 
all values of k and appears to be the most suitable of the above definitions. Attention will 
therefore be confined to r® in the rest of this paper when dealing with serie! correlations 
involving an estimated mean. 

2-2. It will be evident that the definitions (2-02)—(2-04) differ only by terms of order n-*, 
and sampling investigations have shown that there is little to choose between them from 
the point of view of either their biases or their variances. 


3. MoMENTS OF THE SERIAL CORRELATION COEFFICIENT IN SAMPLES 
FROM THE MOVING AVERAGE SCHEME 2,=€,+ 6, 


3-1. In this and succeeding sections the superscript (3) in 7? will be dropped for con- 
venience. 

The second-order unweighted moving average scheme is defined as x, = ¢,+¢,_,. In the 
subsequent sections ¢, will be taken as a random normally distributed variate with zero mean 
and unit variance. It then follows that &(2,) = 0 and &(2?) = 2. 

Writing r, = N,/D, where 


M, = — my Type — jaa an *) (E aus): (3-01) 


and &(N,) = v4, €(D) = 3 we have, to order n-, 
{1- cov (ND) ‘ var (D)\_ 
v,0 é 
The evaluation of (3-03) needs to be carried out separately for k = 1, 2 and k>3. 


A little consideration shows that, to order n-', both cov (ND) and var (D) are unaffected 
by estimation of the mean. That is, if 





6(r,) =F (3-03) 


n—k 
N= sak 2% ed bad 
ned 
“a4 
then cov (ND) = cov (Nj, D’) to order n-, (3-04) 
var (D) = var (D’) to ovder n-. (3-05) 
3-2. For k = 1, noting that &(2,z,,;) = 0 for j > 2, it follows by straightforward algebra 
that pe 
Vy ” (n— 1)? ? (3-06) 
2(n?—2n+1 
é = Sth) (3-07) 


+ While this work was being prepared for publication the authors learned that general results for the 
first sample moment of serial correlation coefficients, including the formulae of §§ 3-1 and 4-1 as special 
cases, have been derived by Prof. M. G. Kendall. See his note following this paper. 
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For the evaluation of &(D’*) the following results, which may be easily proved, are required 


E(af) = 12, F(afat,,) = 6, E (xf 27.3) = 4 (j2>2). (3-08) 
n 2)" 
Then é(D") = ao (( +) 


ra l n n—-ln-t ) 
a ad” Spat iF ym 


' 4(n?+3n-—1 
= ate), (3-09) 
and, since &(D’) = 2 
£irvaged 
var (D') = —-—s- (3 10) 
12 1 
Hence var (D) = +0(55) : (3-11) 


In a similar manner it is easy to show that 
8 1 
cov (N, D) = — +0(5). (3-12) 
Substituting these results in (3-03) gives 


1 3 1 
If the true mean is known to be zero the corresponding result is 
Est 1 
ee ¥.? y 
(rt) = 5-5 + (=) (3-14) 
3:3. The results for k = 2 and k>3 are obtained in the same manner, and are found to be 
5 1 
6 (14) = - 5+ (=) ; (3-15) 
2 1 

6() = —=+ o(-3) (k> 3). (3-16) 


When the true mean is known to be zero the exact result 
E(rt)=0 (k>2) 
is, of course, obtained. 
3-4, Expressions for the variance of r, may be derived using theresult, correct to order n-1, 
_ ¥y{var(N,) 2cov(N,D) , var(D) 
var (ry) = 3 a - 8 + nb 


In this case the leading term in the expansion of var (r,) is the same for all k > 2, and it is 
therefore only necessary to evaluate (3-17) separately for k = 1 and k>2. Using the fact 
that var (N,) = var(N;) to order n-! some straightforward algebra leads to the zesults 


var (r,) = mt (=) = var (r¥), (3-18) 





(3-17) 


var (r,) = =+ (=) = var(rt) (k>2). (3-19) 
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4. MOMENTS OF THE SERIAL CORRELATION COEFFICIENT IN SAMPLES 
FROM THE MARKOFF SCHEME 2, = P2,_,+ 6; 


4:1. The mean and variance of r, may be evaluated to order n-! using formulae (3-03) 
and (3-17). It will be assumed that | p | < 1 and that ¢,is again arandom normal variate with 
zero mean and unit variance. 

A general formula for &(r,,) may be derived which is valid for all positive values of k. 

Since #(x,2,,;) = p/ var (x,), where var (x,) = 1/(1—p*) 








disap (2 
Y= parapet ms) ates 
1 1 1 
a= mart Ge: li 
In order to evaluate var (D), etc., the general result 
+m 1 + 2p¥ 
O (2,2 Mer %+k+4+m) = ee (4-03) 


is necessary. Then 
vo - el 34) 


t 
= lamar? n- ? 





(1—)*)? 
alia 2(1 +p?) i 
7 apart apm TU 
var (D’) = face meen + Os i); (4-04) 


Again &(Ni,D’) 


» wage (2 = con (3 ~ )| 


FAB 20H Sete) + (0-H) Z Baths) 





+ 2" 5 = " —k-j) E eeisn ttn] 


be ( +) la Sta coe wat As) 











if 2p*{(k + 1) — (k—1)p%} ’ 
~ appt pt G8) sa 
» py = P(E +1)—(k—-1) 0} | ’ 
cov (Ni, D’) eT +0(-5 i). (4-06) 
Substituting these results in (3-03) gives after some algebraic simplification 
é(r,) = pr—= (I +p)(1l+p+p?+... +p) +2894} +0(5) , (4-07) 


When the true mean is known to be zero the corresponding value for r¥ is 


(rt) = pk = +0(5). (4-08) 
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4-2, An asymptotic formula for var (r,,) to order n-! has already been derived by Bartlett — 
(1946). His result, which has been confirmed by the authors, is 


2 <a 
var (r,) = fC re? Das 2p + (53) (4-09) 


The expression (4-09) holds also, of course, for var (rf). 





5. SAMPLING INVESTIGATIONS 


5-1. The results derived in §§ 3 and 4 were compared with the sampling distributions of 
r, and r, for series of different lengths drawn from artificially constructed stochastic series. 

5-2. A moving average series containing 1500 terms in all was constructed according to 
the formula x, = ¢,+¢,_,. The ¢,s which had zero mean and unit variance were read con- 
secutively from tables prepared by Wold (1948). The series was started up with a random 
deviate €,, x, being then taken as €,+¢, and so on. 

The series was first subdivided into 75 consecutive portions each containing 20 terms and 
the values of r, and r, calculated for each sample. The values obtained are given in Table 1. 
The series was then regrouped into 37 sets of 40 items each and the first and second serial 
correlations for each of these sets are shown in Table 2. Lastly, the series was divided into 
25 sets each containing 60 terms and the first and second serial correlations of these samples 
calculated. These are shown in Table 3. 

The frequency distributions of r, and r, are presented in Tables 4 and 5, together with 
their means and variances. 

5-3. It will be noted that for each length of series the successive values of r, and r, were 
calculated from contiguous portions of the whole series and the values of r, and r, obtained 
are accordingly not independent. However, for this particular series, p, = 0 for k>2, and 
the effect of non-independence between successive values of r, and r, on the sampling 
distributions of these correlations given in Tables 4 and 5 should be small. 

The mean values for both 7, and r, are seen to be in good agreement with the theoretical 
formulae. In all cases the difference between the observed and theoretical bias is much less 
than twice its standard error. In addition, the sampling variances also show good agreement 
with the theoretical values, none of the observed differences being significant as judged by 
the x? test (x? = fs?/o*, f = degrees of freedom for s?). 

5-4. The sampling distributions of r, and r, were also obtained for samples of size 20, 40 
and 60 from an artificially constructed Markoff series with p = 0-4. In order to provide 
a reasonable number of values for the study of these distributions in samples of size 60 a 
total of 2100 terms were included in the artificial series. The series was started up with 
a random normal variate with mean zero and variance {1 —(0-4)?}-!, the random terms 
thereafter being read consecutively from the tables given by Wold (1948). 

The first 10 terms of the series were discarded and samples of size 20, 40 and 60 drawn 
consecutively, 10 terms being omitted between each sample. In all 30 samples of size 60, 40 
samples of size 40, and 60 samples of size 20 were taken. The correlation between the last 
term of one sample and the first term of the next at a spacing of 10 is of the order of 0-0001. 
The values of r, and r, are given in Tables 6, 7 and 8 and the corresponding frequency dis- 
tributions in Tables 9 and 10. The bias clearly diminishes with increasing 7 and in all cases 
the differences between the observed and theoretical biases are much less than twice their 
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standard errors. The theoretical values given are based on the known population parameters, 
but the standard errors are estimated from the actual sampling variances. 

The observed variances, on the other hand, although decreasing with increasing sample 
size, are in all cases larger than the theoretical results. Of the six variances only three do 
not differ significantly from their theoretical values on the basis of the x? test. 

5-5. A second Markoff series this time with a parameter 0-8 was constructed. This series 
contained 2400 terms. It was started up with a random normal variate with zero mean and 
variance {1 — (0-8)?}~1. The first 20 terms were discarded and samples of size 20, 40 and 60 
drawn consecutively omitting 20 terms between each sample. At this spacing the correlation 
between the last term of one sample and the first of the next is of the order of 0-01. The values 
of r, and r, are shown in Tables 11, 12 and 13 and the corresponding frequency distributions 
in Tables 14 and 15. 

The observed means are again in good agreement with expectation, the differences 
between the observed and the theoretical bias being all less than twice their standard errors. 

The agreement between the sample variances and the theoretical values is, on the other 
hand, disappointing. Except for the value 0-0707 all the observed variances are significantly 
too high as judged by the x? test. 


6. Discussion 


6-1. Itis clear from the results of the previous sections that estimates of autocorrelations 
of stationary time series are liable to quite large biases. The sampling investigations in- 
dicate that the estimates of bias in the particular series dealt with here should be adequate 
for most practical purposes. The estimates of variance in the Markoff scheme do not appear 
satisfactory even for long series. 

Although only the bias due to the fitting of a single constant in two simple types of 
stochastic series has been considered, it seems likely that when more complicated models 
are dealt with and further constants fitted the bias will generally be at least as serious. In 
all cases where trend is removed by curve fitting using least squares, however, the bias will 
tend to zero with increasing sample size provided, of course, the correct order of trend is 
fitted. 

6-2. When moving averages are used for trend elimination, the situation is rather 
different. This method gives rise to a new correlogram which corresponds to a differencing 
of the original, and the bias in the serial correlations of the moving average residual series 
does not in this case tend to zero as n increases indefinitely. 


The authors wish to express their thanks to Miss H. McDonald and Miss R. Mair for 
considerable assistance in carrying out much of the laborious computations. 
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eters, 
Table 1. Values of r, and r, in samples of size 20 from the moving average scheme x, = €,+ €_1 
ample ‘ j 
ree do Series vr; YT. Series tr; tT. Series vr; Ts 
series 1 0-446 — 0-055 26 0-516 0-016 51 0-325 — 0-156 
n and 2 0-328 —0-301 27 0-476 — 0-050 52 0-411 — 0-024 
nd 60 3 0-381 — 0-359 28 0-449 — 0-064 53 0-507 0-080 
‘ 4 0-616 0-171 29 0-480 — 0-093 54 0-474 0-027 
lation 5 0-555 — 0-070 30 0-301 — 0-096 55 0-478 — 0-234 
4 
alues 6 | o171 | 0-268 | 31 | 0-248 | 0-213 | 56 | 0-530 0-169 
itions 7 0-334 0-068 32 0-369 — 0-222 57 0-483 — 0-128 
8 0-296 — 0-052 33 0-571 0-235 58 0-434 0-011 
9 0-645 0-208 34 0-467 — 0-168 59 0-334 — 0-290 
ences 10 0-621 0-015 35 0-353 —0-691 60 0-292 — 0-520 
rrors, 
oth 11 0-380 — 0-423 36 0-336 —0-510 61 0-446 — 0-335 
er 12 0-540 — 0-096 37 0-240 — 0-470 62 0-647 0-397 
antly | 13 0-561 0-099 38 0-553 0-256 63 0-334 —0-271 
14 0-198 — 0-445 39 0-490 — 0-132 64 0-305 — 0-376 
15 0-671 0-363 40 0-469 — 0-364 65 | 0-427 — 0-237 
16 0-506 —0-010 41 0-120 — 0-638 66 0-435 — 0-196 
17 0-313 —0-194 42 0-478 — 0-291 67 0-546 — 0-027 
tions 18 0-381 — 0-247 43 0-260 — 0-257 68 0-717 0-188 
: 19 0-359 — 0-240 44 0-282 — 0-328 69 0-539 — 0-052 
iS In- 20 0-215 — 0-448 45 0-662 0-094 70 0-545 0-136 
uate 
21 0-322 — 0-386 46 0-598 0-259 71 0-445 — 0-232 
ypear 22 0-516 — 0-122 47 0-410 —0-190 72 0-323 — 0-462 
23 0-309 — 0-316 48 0-166 — 0-341 73 0-542 — 0-065 
wale 24 0-280 —0-317 49 0-496 0-053 714 0-229 — 0-440 
25 0-446 0-042 50 0-284 — 0-267 15 0-364 — 0-322 
odels | 
s.In . 
n | ; , 
re Table 2. Values of r, and r, in samples of size 40 from the moving average scheme x, = €,+€_, 
nd is 
ther | Series r; Ts Series ; 1. Series rT; 1. 
icing 
orkés 1 0-456 — 0-154 16 0-416 —0-019 31 0-585 0-157 
2 0-489 —0-073 17 0-494 — 0-007 32 0-371 —0-182 
3 0-363 —0-151 18 0-356 — 0-559 33 0-462 —0-112 
4 0-341 0-009 19 0-353 —0-189 34 0-634 0-137 
ie 5 0-642 0-147 29 0-466 —0-241 35 0-605 0-137 
6 0-492 —0-140 2i 0-352 — 0-330 36 0-380 — 0-325 
7 0-554 0-077 22 0-309 — 0-296 37 0-561 —0-021 
8 0-557 0-070 23 0-638 0-145 
9 0-354 — 0-156 24 0-286 — 0-248 
10 0-331 — 0-300 25 0-411 — 0-064 
ll 0-409 — 0-223 26 0-420 0-030 
12 0-285 — 0-291 27 0-440 0-007 
) 13 0-550 0-077 28 0-505 0-039 
| 14 | 0-483 0-024 -| 29 | 0-466 | —0-078 
15 0-397 — 0-107 30 0-322 — 0-391 















































Table 3. Values of r, and r, in samples of size 60 from the moving average scheme x, = €,+€ 





























Series T; 1, Series Ty 1. Series rT T. 

1 0-461 —0-144 ll 0-476 0-038 21 0-527 0-031 
2 0-489 0-038 12 0-379 —0-445° 22 0-431 —0-144 
3 0-457 0-104 13 0-387 — 0-152 23 0-648 0-188 
4 0-534 — 0-095 14 0-393 — 0-325 24 0-400 —0-231 
5 0-585 0-148 15 0-561 —0-011 25 0-491 — 0-120 
6 0-414 — 0-092 16 0-499 0-149 
7 0-329 — 0-305 17 0-387 — 0-091 
8 0-426 — 0-164 18 0-524 0-120 
9 0-548 0-092 19 0-495 — 0-035 

10 0-422 — 0-092 20 0-365 — 0-316 











Table 4. Frequency distributions of r, in samples from the moving average scheme x, = €,+¢ 

















T; n= 20 n= 40 n= 60 
0-70—0-80 1 — — 
0-60- 6 4 1 
0-50—- 15 6 6 
0-40— 20 13 12 
0-30- 19 12 6 
0-20- 10 2 — 
0-10- 4 — — 

Total 75 37 25 
Mean 0-421 0-447 0-465 
Bias — 0-079 — 0-053 — 0-035 
Predicted bias — 0-075 — 0-038 — 0-025 
8.E. of mean 0-0154 0-0170 0-0155 
Variance 0-0178 0-0106 0-0060 
Predicted variance 0-0250 0-0125 0-0083 





Table 5. Frequency distribution of r, in samples from the moving average scheme x, = €,+6 , 


























T, n= 20 n=40 n= 60 
0-30-0-40 2 — — 
0-20- 4 — — 
0-10- 4 5 5 
0-00—- 10 8 4 
—0-10- 13 6 6 
—0-20- 8 8 5 
—0-30- 13 6 1 
—0-40- ll 3 3 
—0-50- 6 —_ 1 
— 0-60- 2 1 --— 
—0-°70- 2 — a 
Total 75 37 25 
Mean — 0-150 — 0-097 — 0-074 
Bias — 0-150 — 0-097 — 0-074 
Predicted bias —0°125 — 0-062 — 0-042 
S.E. of mean 0-0268 0-0285 0-0334 
Variance 0-0539 0-0302 0-0280 
Predicted variance 0-0750 0-0375 0-0250 









































Table 6. Values of r, and r, in samples of size 20 from the Markoff scheme x, = 0-42,_, +6, 
































Series T, 1. Series r; Ys Series T 1, 
1 0-389 0-199 21 0-203 — 0-227 41 0-390 — 0-204 
2 0-604 0-269 22 — 0-187 — 0-239 42 0-283 —0-015 
3 0-530 0-155 23 0-018 — 0-369 43 0-083 — 0-159 
4 0-477 0-220 24 0-394 0-041 44 0-568 0-368 
5 0-151 — 0-167 25 0-129 — 0-346 45 0-247 —0-119 
6 0-630 0-407 26 0-333 — 0-284 46 —0-114 — 0-024 
7 0-595 0-420 27 0-460 0-023 47 0-112 —0-071 
8 0-379 0-161 28 0-216 0-048 48 0-514 0-299 
9 0-629 0-262 29 0-595 0-141 49 0-254 —0-113 
10 0-195 — 0-427 30 0-185 0-299 50 0-510 0-049 
ll 0-628 0-152 31 —0-116 — 0-291 51 0-420 — 0-133 
12 0-256 0-302 32 0-288 — 0-302 52 0-178 — 0-094 
13 0-360 —0-101 33 0-194 — 0-095 53 0-038 —0-731 
14 0-255 0-087 34 0-187. 0-173 54 0-433 0-440 
15 — 0-265 — 0-405 35 0-023 — 0-228 55 — 0-219 — 0-063 
16 0-295 — 0-389 36 0°529 0-380 56 0-329 — 0-416 
17 0-248 — 0-232 37 0-278 — 0-076 57 | —0-051 0-034 
18 0-260 0-047 38 0-472 0-014 58 0-359 —0-313 
19 0-668 0-542 39 0-201 0-207 59 0-247 —0-191 
20 0-381 — 0-003 40 0-228 0-021 60 0-751 0-471 








Table 7. Values of r, and r, in samples of size 40 from the Markoff scheme x, = 0-4a,_, +€ 
































Series T; T. Series v, 1. Series Tr; 1. 

1 0-282 0-288 16 0-404 — 0-083 31 0-422 —0-112 
2 0-375 0-132 17 0-177 0-150 32 — 0-093 — 0-339 
3 0-242 —0-143 18 0-201 0-173 33 0-095 — 0-106 
4 0-660 0-457 19 0-147 —0-178 34 0-429 0-078 
5 0-396 — 0-003 20 0-556 0-381 35 0-277 —0-313 
6 0-503 0-089 21 0-008 — 0-097 36 0-695 0-507 
7 0-625 0-283 22 0-519 0-403 37 0-053 —0-104 
8 0-458 0-164 23 0-447 0-178 38 0-359 — 0-043 
9 0-139 — 0-088 24 0-481 0-202 39 0-360 0-161 

10 0-306 — 0-090 25 0-343 —0-014 40 0-659 0-380 

11 0-388 0-111 26 0-252 0-184 

12 0-311 0-062 27 0-450 0-157 

13 0-139 — 0-094 28 0-031 — 0-003 | 

14 0-424 0-003 29 0-666 0-385 

15 0-044 — 0-149 | 30 0-499 | 0-112 | 











Table 8. Values of r, and r, in samples of size 60 from the Markoff scheme x, = 0-4a,_,+& 





















































Series T, T. Series T, ts Series T 1. 
1 0-285 0-245 1l 0-111 — 0-343 21 0-589 0-338 
2 0-305 —0-121 12 0-405 0-202 22 0-397 — 0-043 
3 0-598 0-456 13 0-435 0-130 23 0-134 0-066 
4 0-560 0-297 14 0-427 0-096 24 0-285 0-046 
5 0-558 0-182 15 0-162 — 0-024 25 0-215 —0°137 
6 0-397 0-149 16 0-494 0:308 26 0-607 0-348 
7 0-063 — 0-229 17 0-424 0-221 27 0-297 —0-110 
8 0-554 0:378 18 0-346 — 0-054 28 0-329 0-085 
9 0-279 — 0-006 19 0-405 0-174 29 0-631 0-284 
10 0-271 — 0-014 20 0-141 —0-016 30 0-468 0-307 
Biometrika 41 26 
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Table 9. Frequency distributions of r, in samples from the Markoff scheme x, = 0-4x,_, +, 


Table 10. Frequency distributions of r, in samples from the Markoff scheme x, = 0-42,_, +€; 
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rT; n= 20 n= 40 n= 60 
0-70—0-80 1 — —_— 
0-60- 5 5 2 
0-50- 7 3 5 
0-40— 5 9 7 
0-30- 9 8 5 
0-20- 15 5 6 
0-10- 8 4 4 
0-00- 4 5 1 

—0-10- 1 1 — 

— 0-20- 3 — — 

— 0-30- 2 _— _ 
Total 60 40 30 
Mean 0-294 0-343 0-372 
Bias — 0-106 — 0-057 — 0-028 
Predicted bias —0-110 — 0-055 — 0-037 
8.E. of mean 0-0297 0-0315 0-0294 
Variance 0-0529 0-0398 0-0258 
Predicted variance 0-0420 0-0210 0-0140 





























; n= 20 n=40 n= 60 
0-50-0-60 1 i — 
0-40- 4 2 1 
0-30- 3 3 5 
0-20- 6 3 5 
0-10- 6 10 4 
0-00- 9 4 4 
—0-10- 8 9 6 
— 0-20— 7 6 3 
—0-30- 7 — 1 
— 0-40- 5 2 1 
— 0-50— 3 — _ 
— 0-60- _ _ _ 
—0-70— as eae ee 
— 0-80- 1 —_ _ 
Total 60 40 30 
Mean —0-010 0-077 0-107 
Bias — 0-170 — 0-083 — 0-053 
Predicted bias — 0-130 — 0-065 — 0-043 
8.E. of mean 0-0347 0-0326 0-0355 
Variance 0-0722 0-0424 0-0378 
Predicted variance 0-0622 0-0311 0-0207 












































Table 11. Values of r, and r, in samples of size 20 from the Markoff scheme x, = 0-82,_, + € 








Series T Ts Series Tr; Ts Series T 1; 
1 0-566 0-061 21 0-706 0-463 41 0-689 0-431 
3 0-773 0-573 22 0-233 — 0-140 42 0-753 0-558 
3 0-222 0-152 23 0-558 0-422 43 0-933 0-774 
4 0-474 0-147 24 ‘282 —0-110 44 0-613 0-159 
5 0-649 0-207 25 0-552 0-356 45 0-855 0-661 
6 0-738 0-378 26 0-440 0-116 46 0-774 0-638 
y | 0-252 0-046 27 0-833 0-684 47 0-620 0-339 
8 0-713 0-387 28 0-796 0-566 48 0-406 — 0-204 
9 0-395 0-025 29 0-505 0-384 49 0-529 0-336 
10 0-333 0-101 30 0-238 —0-190 50 0-463 0-093 
1l 0-769 0-448 31 0-752 0-496 51 0-694 0-479 
12 0-289 — 0-058 32 0-554 0-169 52 0-643 0-584 
13 0-643 0-274 33 0-448 0-051 53 0-756 0-440 
14 0-580 0-441 34 0-892 0-679 54 0-646 0-387 
15 0-321 0-306 35 0-736 0-651 55 0-902 0-775 
16 0-670 0-417 36 0-322 — 0-067 56 0-649 0-321 
17 0-780 0-570 | 37 — 0-002 — 0-065 57 0-822 0-604 
18 0-471 0-031 38 0-434 — 0-107 58 0-637 0-156 
19 0-743 0-584 39 0-254 —0-114 59 0-589 0-290 
20 0-617 0-178 40 0-758 0-514 60 0-534 0-023 



































Table 12. Values of r, and r, in samples of size 40 from the Markoff scheme x, = 0-82,_, + & 








Series rT, 1, Series rT; Ts. Series rT, 1. 
1 0-702 0-367 16 0-431 0-055 31 0-762 0-507 
2 0-620 0-443 17 0-661 0-436 32 0-746 0-614 
3 0-811 0-692 18 0:747 0-537 33 0-649 0-383 
4 0-755 0-524 19 0-715 0-423 34 0-779 0-643 
5 0-789 0-696 20 0-498 0-248 35 0-765 0-547 
6 0-564 0-286 21 0-851 0-708 36 0-488 0-192 
7 0-582 0-299 22 0-818 0-642 37 0-807 0-619 
8 0-412 0-123 23 0-861 0-700 38 0-793 0-543 
9 0-710 0-452 24 0-481 0-090 39 0-640 0-199 


10 0-676 0-442 25 0-580 0-367 40 0-770 0-602 


ll 0-822 0-652 26 0-523 0-262 
12 0-570 0-009 27 0-647 0-368 
13 0-780 0-667 28 0-920 0-879 
14 0-683 0-462 29 0-767 0-533 
15 0-725 0-398 30 0-766 0-594 





Table 13. Valuee of r, and r, in samples of size 60 from the Markoff scheme x, = 0-8x,_, + &; 








Series rT; T. Series Tr; Ts Series Tr; 1s 
1 0-751 0-473 ll 0-582 0-354 21 0-886 0-815 
2 0-447 0-308 12 0-843 0-773 22 0-772 0-525 
3 0-732 0-441 13 0-807 0-697 23 0-831 0-671 
4+ 0-823 0-679 14 0-790 0-596 24 0-752 0-596 
5 0-477 0-167 15 0-532 0-299 25 0-609 0-327 
| 
6 0-663 0-388 16 0-815 0-657 26 0-837 0-706 
7 0-710 0-508 17 0-854 0-675 27 0-565 0-273 
8 0-671 0-510 18 0-601 0-355 28 0-830 0-683 
9 0-669 0-293 19 0-719 0-539 29 0°725 0-418 
10 0-724 0-539 20 0-592 0-314 30 0°827 0-702 
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Table 14. Frequency distributions of r, in samples from the Markoff scheme x, = 0-8x,_,+€ 


Table 15. Frequency distributions of r, in samples from the Markoff scheme x, = 0-8x,_, + 
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rT; n=20 n= 40 n= 60 
0-90-1-00 g 1 — 
0-80- 4 6 10 
0-70- 14 16 9 
0-60-— 12 a 5 
0-50- 9 5 4 
0-40- 7 5 2 
0-30- 4 oo os 
0-20— 7 -— a 
0-10- _— a — 
0-00- — — —_ 
—0-10- 1 — a 
Total 60 40 30 
Mean 0-580 0-692 0:714 
Bias — 0-220 — 0-108 — 0-086 
Predicted bias — 0-170 — 0-085 — 0-057 
S.E. of mean 0-0264 0-0197 0:0217 
Variance 0-0419 0-0156 0-0141 
Predicted variance 0-0180 0-0090 0-0060 






































T, n= 20 n=40 n= 60 
0-80—-0-90 os 1 1 
0-70- 2 2 3 
0-60- 6 9 6 
0-50- 7 7 7 
0-40- 9 6 3 
0-30- 9 5 6 
0-20- 3 + 3 
0-10- 8 3 1 
0-00- 7 3 —~ 

—0-10- 3 — — 

—0-20- 5 _— 

— 0-30- 1 —_ _ 
Total 60 40 30 
Mean | 0-298 0-455 0-509 
Bias | 0-342 — 0-185 —0-131 
Predicted bias | — 0-290 — 0-145 — 0-097 
8.E. of mean 0-0343 0-0321 0-0323 
Variance | 0-0707 0-0412 0-0314 
Predicted variance 0-0526 0-0263 0-0175 
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NOTE ON BIAS IN THE ESTIMATION OF AUTOCORRELATION 


By M. G. KENDALL 
Division of Research Techniques, London School of Economics 


1. It may be convenient to adjoin to the foregoing paper by Dr Marriott and Mr Pope some more 
general results giving biases to order n-!. These were obtained by Mr B. Gluss, Mr J. Wise and myself. 
Mr Wise has some methods of greater generality for dealing with serial correlations, but we have not yet 
embarked on the algebra required to evaluate terms of n-? in any but the simplest cases. 


2. Defining a coefficient in terms of three quadratic forms, A, B, C, as 








Pm... 1 
~ (BO) Om 
we have, to order n-', 
ei ve __ Blab) __ plac), Ble), BH(*) , 3B(6*) = 
~ {2(B) E(C)} E(A) E(B) E(A)E(C) E(B) E(C) EXB) EXC)}’ 
where a, b, c are the deviations of A, B, C from their respective means. 
1 2k 1 n—k \2 
If we now define B= (n—k) 24- Gao Z| ’ (3) 
1 "2 1 "Ss 2 
C= nok 7” |, on , (4) 


it is easy to see from considerations of symmetry that 
E(B) = E(C); E(ab) = E(ac) = cov(a,b), .2(b?) = E(c?) = varb. 








Also we have E(bc) = E(b*) + O(n-*), (5) 
_ E(A) cov(a,b) H(A) varb 
and thus, from (2), E(r,) = E(B) EXB) EXB) (6) 


The same expression is reached if we put B = C in (1), as is noted by Marriott and Pope. 


3. Without loss of generality we let the variance of the series be unity and write n—k =v. By a 
straightforward evaluation of expectations we then find 


E(B) = 5 (>-1-3"2 >» 0 ap,). (7) 
4 valk 1 ss 1 s s 
and takin; A = — Xx, -— x, x, . 8 
: Ort eet in iid k)? (‘= ) (‘= i) ©) 
1r-k-1 : 
we find (A) = 5 P52, = 0-2) Pes z (PI) Pe a = (rk), (k>0). (9) 
To order n-! we have, for Bian variation, 
2 ioe] 
varb=- pi, (10) 
Vj=-—a 
2 @ 
cov(a,b)=- L psPjane (11) 
Vj=-—ao 


Thus (6) can be evaluated by substituting from (7), (9), (10) and (11). 
4. Case I. Random series: p, = 0 (k+0). 


We find E(r,) = -<. (12) 
Case II. p, = p, p, = 0 (k#0, 1). 
1 
We find E(r,) = p+>(1+p)(4p?— 2p— 1), (13) 
1 
E(r,) = —5(1+2p + 2p"), : (14) 


1 
E(r,) =-5(1+2p) (k>2). (15) 
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Case III. p,, Pa, Ps not zero; p, = 0 (k+0,1, 2, 3). 
We find 
1 
E(r,) = p+ > {— 1 — 3p, — 2p, — 2ps— 2p, ps + 21 ps — 42s + 2pi + 4} + 4p, 03 + 4p5 p31}, (16) 


1 
Er) = py+={—1— 2p, —3p.— 2p— 2pi— 491 Ps + 2p1P2+ 202 + 2apst 4pips+ 42+ 4p2p3}, (17) 


1 
E (rs) = ps +> {—1—2p,— 2p,—3ps— 4p: 02+ 2p Pat paps + 2ps + 4pips + 4p3p5 + 43}, (18) 
1 
K(r,) = —7 (1 + 2p1 + 2p + 2s). (19) 
- l+p 
‘ase IV. Markoff scheme. E(r,) = p*- ious —p*)+ 2kp*}, (20) 
and in particular E(r,) = p- +*, (21) 


Equation (13) with p = } gives us Marriott and Pope’s formula (3-13); equation (14) and (15) likewise 
give their (3-15) and (3-16). Equations (20) and (21) agree with their (4-07). 
Case V. Case I with a circular definition, i.e. 





eT 2 1 “Sy (22) 
a= 4 =( y x) 
Nt=1 n* \t=1 
We find E(r,) = -< (k+0). (23) 
Case VI. Case II with a circular definition. 
We find B(ry) = p= (1+4p—2p*— 4p), (24) 
1 
E(r,) = — 5 (1+2p+2p%), (25) 
1 
E(r,) =—=(1+2p) (k>2). (26) 
Case VII. Case III with a circular definition. 
E(r,) = Byr,)—, (27) 
2 
E(r,) = E,(r)— =e, (28) 
3 
E(r5) = B,(r,)-=?, (29) 
E(r,) = Ey(rx) (k>3), (30) 


when E£, refers to the corresponding expectations of case ITI. 
Case VIII. Case IV (Markoff) with a circular definition. 


1f1+ 
E(r,) = pr 718 1p) + Bhp — kor, (31) 


and in particular, for k = 1, E(r,) = p-~(1 +4p). (32) 


5. Expressions such as these are probably satisfactory for values of p near to zero, but they are of 
very doubtful validity for p near to unity. For one thing, the distribution of r is, in general, so highly 
skewed that the use of expectations as criteria of bias is itself open to question. For another, the use of 
expansions such as those employed in this note, which in general are asymptotic, may be dubious where 
there is not a rapid fall in successive terms near the beginning. It is not necessarily true that better results 
would be obtained by evaluating further terms to order n-* or n-’. We are inclined to think that the 
problem is most likely to yield to a new approach. 
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TESTS OF HYPOTHESES IN THE LINEAR 
AUTOREGRESSIVE MODEL 


1. NULL HYPOTHESIS DISTRIBUTIONS IN THE YULE SCHEME 


By G. M. JENKINS 
University College, London 


1. INTRODUCTION 


The stochastic approach in.time series, namely, that of determining whether a sequence of 
random variables could have been generated by a given process, is one which has received 
considerable attention since Yule (1927) fitted an autoregressive series to Wolfer’s sunspot 
numbers. 

In the case of the autoregressive model, it has been generally accepted that the ‘best’ 
method of fitting is to test for a model of increasing order until an arbitrary number of non- 
significant results is obtained. Whittle (1952) has discussed how this procedure may be 
regarded as including all purely non-deterministic stationary processes as alternative 
hypotheses to the autoregressive model considered. 

Up to the present, valid inferences have been hindered by the following considerations: 

(1) The sampling distributions of the test statistics considered were not known, thus 
making it necessary to assume that the null hypothesis distributions are approximated by 
the analogous forms in the theory of multiple regression. 

(2) As a result, large sample tests have been derived by Quenouille (1947) and Whittle 
(1952). In the case of the former, it has been shown, for example, by Rao & Som (1951) 
that the test is not satisfactory for short series. It may thus be inferred that the same is 
true of the latter, since the asymptotic nature of the approximation is the same in both 
tests. 

It is thus proposed to consider the distribution problem systematically, for the present 
confining the discussion to the testing of hypotheses in the Yule scheme. 

In order to determine the distributions of the test criteria (which take the form of partial 
and multiple serial correlation coefficients) it is necessary to know the joint distribution of 
the serial correlations of different lags. The only paper which has appeared on this subject 
is that by Quenouille (1949a), who derives an explicit expression for the joint distribution 
of the first k serial correlation coefficients. The resulting distribution is intractable, and hence 
an integral approximation is suggested as a k-dimensional analogue to the smoothed form* 
for p(r,) proposed by Dixon (1944). It will be shown subsequently that whereas the integral 
form has correct moments as far as the marginal distribution of r, is concerned, other 
marginal and multivariate moments are incorrect. 


* This has the same moments as the exact distribution up to order n and is represented by a single 
function throughout the range of the variable, whereas the exact distribution is defined by different 
functional forms for various sections of the range. 
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2. ScoPE OF PRESENT STUDY 


The greater part of the paper is devoted to the case where the observations are assumed 
to be drawn from a population with zero mean. Methods are considered for obtaining the 
bivariate moments of the joint distribution of the first two circularly defined serial coeffi- 
cients and of the univariate moments of the first partial serial coefficient. A smoothed joint 
distribution for p(r,,7,), which is the two-dimensional analogue of the Dixon distribution, is 
constructed from a knowledge of these moments. It is found that the smoothed distribution 
of the multiple serial correlation coefficient of x; on z;,, and 2;,, is the same as that of the 
ordinary multiple correlation coefficient based on n + 3 observations. The analysis is then 
modified to deal with the case where the serial coefficients are corrected for the sample 
mean and the theory illustrated by results on artificial series. 

It is proposed to deal at a later stage with non-central distributions in the Yule scheme, 
the extension to higher order schemes and applications to real and artificial series. 


3. MAXIMUM-LIKELIHOOD CRITERIA 


The problem may be formalized as follows: 
Given a realization {x,} (i = 1, 2, ...,m) of a time series 7’, it is assumed that the theoretical 
mean of the series is zero and that the underlying model is 


Ly = Hy yy + Ag Xo +A g®s_gt... +O, Xp, +2;, (3:1) 


where z, is a N(0,c) variate and we employ an artificial circular definition z,,; = x;. It is 
required to test various hypotheses about the parameters @,, @», ..., &. 

In the case of the Markoff scheme {a; = 0, 7 > 1} the problem has been discussed by Dixon 
(1944), who obtained a smoothed distribution for 7, agreeing with the exact distribution 
for the first n moments. If the hypothesis {a; = 0, 7 > 1} is tenable, the author (1954) has 
shown that atest of significance for ~, may be made using the inverse sine transformation. 

In the case of a Yule scheme {a,; = 0, j > 2} the various hypotheses and the test criteria 
may be specified in the usual Neyman-Pearson notation: 

(1) Hy: a,+0, a,=0; Hy: a, +0, a, +0; 





—r 
Qin — ] _y2 PRBS rete! | 
Xr 1—v*, where v ia: 
(2) Hy: a, =0, a +0; Hy: a, +0, a, +0; 
A% = 1—u*, where w= r(1 13) 





V{(1-r) (1 -19)} 
(3) Hy: a,=0, a,=0; Hy: a, +0, a, +0; 


Aw = (1—r?)(1—v*) = 1-7). 


1 
1 
some when non-central distributions are considered. 

Whittle (1952) has shown that the least-square statistics (which apply provided the z’s 
are mutually independent whether they are normally distributed or not) are identical with 
the maximum-likelihood criteria quoted above. 





It is to be noted that whereas &, = v, 2, = J ( =) u, a factor which will prove trouble- 
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4. -QUENOUILLE’S DISTRIBUTION 


Quenouille’s integral approximation for the joint distribution of the first k serial correla- 
tions (uncorrected for the mean) takes the following form when k = 2: 

















_1 Tmt) PQn) (ay 
P("1, 72) = m1 T(4n +4) T'(4n — 4) R ? (4 1) 
with the conditions that R;>0 (i = 1, 2), where 
Le tye % 
R, = "1! and R,=|7r, 1 1, |. 
m9 % *, 1! 
2 
The boundary values obtained by equating R, to zero are given by 
2r?-1<r,<l, 
} (42) 
— V{R(1 +12)} <r < V{F(1+79)}. 


If the joint distribution is integrated between the appropriate limits for r,, we obtain 
Dixon’s expression for p(r,), but integration with respect to r, does not give p(r,) which 
Dixon showed to have the same form as p(r,).* This is confirmed by an examination of the 
moments of (4:1). 

Transforming to new variables r, and v = (r,—1}) (1—7?)-, it may be shown that (4-1) 
implies that v is independently distributed of r, with distribution 


p(v) = K(1—v?)Kr-9), (4-3) 
+1 pry 
so that E(rg) = | ( 12P(7;, 12) drzdr, 
5 = 


—iJdts 


+1 (+1 
= [7° [pers p0e) fot =18) + r8}dr ao 


1 
n+2° 


In a similar manner it may be shown that 


n?+7n+3 
ON a a a 
E(r3) = Fin +2)(n +4)" 

These expressions are obviously incorrect because &(r,) = 0 and &(r3) = (n+2)-!. Since 
the univariate moments are known and are the same for both variables, it is necessary as 


a first step in the construction of the joint distribution to evaluate the correct bivariate 
moments. 


5. THE BIVARIATE MOMENTS OF 7(7j, 12) 


These may be obtained directly by considering the expectations of homogeneous forms in 
normal variables. This is an extension to the bivariate case of a technique which is due to 
Moran (1948). Thus 





pa = Strat) = | Phe eee!) (5-1) 


* It has been drawn to the auithor’s notice that this observation was also made by G. S. Watson 
(1951) in a mimeographed thesis, North Carolina State College. 
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This process is made easier by observing that an examination of the n-dimensional space 
of the z’s shows that p(r,,72) is functionally independent of the distribution of p = X23. 


(5-1) may thus be evaluated by dividing the expectation of the numerator by that of the 
denominator. 


It may be shown that /1},, 442, 43; are all zero. As an example of a non-vanishing moment 
we shall evaluate 
‘is oe Bl pe) ’ 
where p = X27, q) = LXj%jy1, Jo = UAjXj40, 
Gi = LA{Xi 41 + 2UH, Hj 41249 
+ QLH Hp pNipeViygt2 LY! Lj %j41%j yy, 
itl<j 
G+it+2 
the summation >’ being over distinct values of i, +1, 7, 7+1, and 
Qo = Laf aio + ZEA, HT eVirg 
+ 22G, M20 pgt2 LD’ Uj Xp,9%j Tj 40. 
i+t1<j 
j+i+1 


Hence & (gi q3) = E[ 227} 107 42+ Lair}, 27,5 
+ Lajri hye + Lajat, 1A, 3+ 42a7 ai, Wess 
+X'x}a?,,x3x3,.+terms with zero expectations]. 
We may take &(z?) = 1 without any loss of generality so that &(24) = 3. Since the last 
summation contains n(n — 4) terms, it may be shown that 


6 (9593) = n(n + 12), 
from which it follows that 
an ie n+12 
Maa ™ (n +2) (n+4) (n +6)" 
The algebra becomes d:fficult after the first few moments, but the following results were 
obtained: 9 


sansa | 


(5-2) 


Mo) = 
5-3 
{ans gan (5-3) 
Ma = (n+ 2) (n+4) (n+ 6)" 
The method is simplified considerably by working with the joint characteristic function of 
fae. ge iat wOuny 
p= 3g8 Uti = 55atiti+ «92 = Toh Mi ti+es 
which is the circulant 


2k ar 


¢= TI |! -6-6, 008 —0, c08—— (5-4) 


It follows from the original form of the characteristic function before integrating out that 


afl Meibbror|a 


where the expression above is intended to convey that after differentiation and equating 
to zero, we integrate successively with respect to 0, (+t) times and then evaluate the 
resulting expression between the limits —0o and 0 for 4. 
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¢ may be rewritten in the form 


12 2k 4nk 
exp [-3 & log) 1-4-4, cos —— — 0,008 || = exp [¥(9, 9,, 4.)]. 
k=1 n n 
The following notation will be used: 

() Ly= 2, My = al 

ks (ne. 

(ii) #, and F,, are the corresponding quantities with ¢ replaced by y. 

(iii) cos = a, cos 2 =f, sothat 2x? =(1+/). 


(iv) 1-0,—0,a-0,8 =A, 1-0) = Ay. 


We shall need to evaluate series of the form > cos® = cos! set or La*f' in our notation. 
k=1 
It may be proved by induction that 
Sat 0, Ene — M2%—1)(2—8)...1 an 





28s! 
Since Lett? = 4004+ 42042, it follows that 


n2s(2s—1)(2s—3)...1 





2-17 — 232 — ; 
La*-18=0, Lah = (6+ 1)! (5-7) 
In analogous fashion, it is seen that 
2 wins => 
Sat igi = 0, Sarge — Mmetts+ 1) (26-1) (26-3)... 1 we 





28+2(s + 2)! 


¢@ may be differentiated successively with respect to 0, to give a system of recursive 
equations, e.g. 


Lg = P[ E59 + 5E yo L'gg + 10 B gg Egg + 15B 9 H3q + LOH Gy Hyg + LOL Gy Egg + Hip), 


k 
and generally, if Hi, H% ... Hj, is a typical term in the expansion of L¢-', where > it; = t, 


=1 
then the coefficient of this term will be ; 
t! 


TI (1,1). 
i=] 


The following observations may now be made: 





(i) Since y = —}2 log {l-0,—0,a-—0,8} 
it follows that E, = ie (3) - (5-9) 
(ii) Using the fact that Xa**-14/ = 0, it follows that M,,_,,; = 0, which implies that 
E(rj*-174) = 0. 


(iii) The only terms which contribute to ¥,, , are those in the expansion of L,, , which 
are of even order; thus for M,,, the relevant terms in D4) are L4) and 2H). 

We proceed to illustrate the method by evaluating 44,. It may be shown that the only 
terms in L,, which lead to rion-vanishing series in Mj, are 


PB 4 + 6H a9 Ly, + 8 }g Ly, + Lup Loy), 
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from which it follows that 


Myz = $[ Faq + 6 Foo Foo + 6F 3, + 3F 39 Foe + Faso For), 
which reduces to 


My = Ag *”—*[Xatf? + 6Xa?f2Xa? + 6(La2f)*? + 3(Xa?)? Dh? + DatDA?]. 
After substituting for the series, this becomes 
My = 3n(n + 10) (m + 28) (1 —09)-#"-4/28, 


3(n +28) 


on tat Ha = GD (n+4) (n+ 6) (n+8)" 





The moments obtained by this method are exact, but it suffers from the disadvantage that 
the number of terms in the expansions increases rapidly with the order of the moment. 

A large number of examples was worked out, and it appeared from the form of the 
moments up to order 12 that the following relationships hold: 


, ___ 28(28—1) (28-3)... 1 
Mas. = (2 42) (n +4)... (m+ 2842)’ 


[(m + 3) + (28 + 1)?] (2s —1)(2s—3)...1 
(n+ 2) (n+ 4)... (n+28+ 4) 








Los, ie. 


The above method will be modified to deal with the case where the serials are corrected for 
the mean in § 9. 


6. THE MOMENTS OF THE FIRST PARTIAL SERIAL CORRELATION 


In this section, three different methods of obtaining the moments of v are discussed. This 
was found necessary since each brings out different features of the distribution. 

Method 1. It is not possible to determine the moments of v by performing operations on 
the exact characteristic function, but this difficulty is overcome by working with the 
smoothed form given by Dixon (1944). The latter is extremely cumbersome and it was not 
found practical to obtain the moments of higher order than 4. 

For &(v) it is necessary 

' op =| 
i) to evaluate | -s5 . 
0) 30,60, 203 Jo, 0 

(ii) to integrate with respect to }{1—(@,—9,)} = x and {1—(0,+9,)} = y between the 
limits 4 and oo for both variables. 

It was found that 

1 
ee ee. 2 oe eh 
Sv) =-—, Se) 
3 3 


ee) =~ aetynssy $= wen ss) 


The pattern in the results is striking because the odd moments are the same as the even 
moments with a change in sign. 

It is to be noted that Dixon obtained the first two moments of the criterion )A3?/4 which is 
equivalent to 1 — v’, and these results are in agreement with the even moments given above. 
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Method 2. It is now assumed that r, and v are independent and the assumption is justified 
at a later stage. This method of approach is extremely interesting in that it leads directly 
to a smoothed joint distribution for the first two serials with correct moments up to order n. 

The assumption of independence in the case of the smoothed distributions will be justified 
by showing that: 

(1) The resulting moments of v obtained by this method are the same as those derived 
by method 1. 

(2) We may transform the joint distribution of r, and v to that of r, and r, and show 
that the moments of the latter distribution are correct up to order n. 

There is some a priori evidence for assuming that the two variates are independently 
distributed, since the condition R,>0 which must be satisfied by any sequence of 


random variables is equivalent to 
(1 —72) (1—v®) > 0. 


It follows that the limits of variation of r, and v are — 1 and +1. 
It will be seen that the procedure is essentially one of constructing a distribution p(r,, 12) 


which has the correct marginal moments—it will be shown subsequently that this leads to 
correct bivariate moments in addition. 


+1 +1 
Since é(r) = | [perv ple) (oC —18) + PB dryao, 
-1J-1 
it follows that One os) = Ain , 
n+2 n+2 
1 
so that &(v) = “ere 


The smoothed distribution of v may then be constructed by evaluating &(r§) for different 
k and then solving the resulting equations for the moments of v. It is simpler to proceed 
as follows: 


br fg the assumption of independence leads to 


Since 1—v = er 5 
E(1—v)F &(1—17?)* = &(1—1,)*, 





giving a system of equations in the form 


(n+1)(n+3)_ n+3 
(n+2)(n+4) n+2’ 
(n+1)(m+3)(m+5) _ n+5 
(n+2)(n+4)(n+6) +2’ 


&(1—v)? 


etc. 





&(1—v)8 


These have solutions 





Max = (n+1)(n+3)... (n+ 2k-1)’ 


(2k —1)(2k—3)...1 
| (61) 


Mon. = — Hox: 


and it may be verified that these are the moments of the type I distribution 


= ig yet (ioe, 
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with p = 4n+1 and q = 4n. This may be rewritten in the form 


. Piet+d » se-on = ; 
P) = Tay Gny v2)Kn—2) (1 — v). (6-2) 


This is to be compared with Quenouille’s smoothed form for the distribution, namely, 


It is precisely the fact that ¢(v) is symmetrical which leads to incorrect moments for 


Pp (r1, 1). 
We may now write the joint distribution of r, and v in the form 


P(r, ¥) = =~ (1-199 (1 — v9)" (1-0), 


-and a transformation yields 





R.\ K-91 — 
Pron) = a(R) a 


In §7 the above distribution will be identified with a smoothed form with correct moments 
up to order n. 
The joint distribution of r, and x = v?, where 


(6-3) 


Plry 2) = = (1—rP)HO—Da-H(1 — x), 


may now be transformed to the joint distribution of r, and 72), where 
(1—T}o) = (1-79) (1-2). 


p(T}%) may then be obtained by integration of the latter distribution with respect to r,, 
using the fact that r, and 73, vary subject to the condition that 0 <7? < T3, <1. Thus 


P(T3o) = $n(1— To), (6-4) 


which is the same as the distribution of the square of the corresponding ordinary multiple 
correlation coefficient based on n +3 observations. 

Dixon (1944) derived the first two moments of ,A?” = (1—73,) from the smoothed 
characteristic function by the tedious differentiation process mentioned earlier and obtained 


n 
Oe) = 48” 
n 
_ rf 
= n+4’ 


where x = ,A?. These results are in agreement with (6-4) and can be obtained directly 
since, °.g. a" 


&(1—To) = &(1—7}) &(1 —v?) ~nt+2nt1 


This must be regarded as strong evidence for the assumption of independence of r, and v 
(or perhaps quasi-independence since the distributions are smoothed). 
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Method 3. A procedure is now outlined which throws light on the precise nature of the 
smoothing involved in deriving the distribution of v in this form. 





We may write &(1—v) = 4) _ > E(r? re), (6-5) 
= =0 
anid it is easily established that , 
A ee 
aA ==> 
giving the formal identity 
s 2 _ 1, &(G-1)(B%—3)...1 
aid ee eienig 1+ (n+ 2)... (m+ 29) ‘ a 7 
It will be shown in §7 that 


_ —_—- (27-1) (27-3)... 1 
& (rj r9) = (n+ 2) (n+4)... (n+27+2)° 


(6-5) may therefore be written in the form 











1-8) = 2 — $ CH= VF-3)-- 1 | __—PH-N@J-9)...1 
m—1 5, (n+2)(n+4)...(m+2j) | j—,(n+4) (+6)... (n+ 2j+2)’ 
which utilizing (6-6) yields é(v) = - 
n+1 
The implications of this procedure will be discussed in § 8. 
7. THE IDENTIFICATION OF THE CONSTRUCTED DISTRIBUTION 
WITH THE ‘SMOOTHED’ FORM 


(a) The moments of the constructed distribution may be obtained directly since 
+1 f+ 
a¢riers) = [° [psd p(0) [old 19) +8 rear a, 


and it may be shown that this expression is equivalent to 


3[E(v*) (m+ 1) (w +3)... (m+ 2t— 1) +0, E(v) (n+ 1)... (m+ 2t—3) (2841) +... 
+C,8(v-*) (n+ 1) (n+)... (m+ 2t—2r—1) (28+ 1) (28 +3)... (284+ 2r—1)+... 
+ (28+ 1) (28 +3)... (28+ 2t—1)], (7-1) 
__ (2g—1)(28—3)...1 
~ (n+2)(n+4)... (n+ 28+ 28)" 
Thus we may derive 3, , for any particular value of t by substituting for &(v’). In the case 
of ¢ = 1, 2, (7-1) becomes 
_ 29(28—1) (2s—3)...1 
ove = (n +2) (+4)... (n+ 2842)’ 
_ [(m+3) + (28+ 1)*] (28 — 1) (28—3)...1 
re = (n +2) (n+4)... (n+28+4) : 


(6) We now proceed to evaluate the bivariate moments from the smoothed characteristic 
function 


where 6 











2n ° 
$= exp| -= | log {a+bc0sa+c00s 2a}da] 
0 
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where a = 1—@,, 6 = --6,, c = —0,. This is simplified by observing from the form of this 


function that 





eae ¥) leew (oat. il. 2 


Our method is then to express 0¢/004 as a function of 0, and 6, only and to expand the latter 
in the form of an infinite series in powers of x = 0,/(1—,). The coefficient of x** in this series 
may then be integrated directly to give &(ri*r4). 
Use could be made at this juncture of Dixon’s form for ¢, but it has been found easier 
to work with a 
log ¢ = -z log {a + b cos a +¢ cos 2a} da, 


and to perform the necessary operations on the integrand, the uniform convergence of the 


integral justifying this procedure. 
It has been established that 
0g a ORS i | nm [?" cos 2a 
Es sigs (T exp |-=|, log (a +6 cos a) da an sibesae” 


which reduces to 
5 (Hl + v(l—24)}}-*4[(1-24)4- 1], {7 = dn}. 


These two quantities may be expanded in the form of infinite series in the following manner: 





whilst for the first factor we utilize an expansion which is originally due to Laplace and 
which was used by Dixon in the univariate case, namely, 





(1+ /(1—24y}- = [a ate. 





22 22 91 
S41) (@+h42)... (642 
Le eh G+ Dat... (7-3) 


The problem thus reduces to one of multiplying the two infinite series given by (7-2) and 
(7-3), and it may be shown that 








86) 1 fi a, F E+ 5+ 2) 645 +3)... 6+ 2) 2 
Cele-0 1—O)|4 § j<2 (j—1)! 277 , 


If the operations outlined previously are applied to the general term of this expansion, it 
may be verified that 
28(28s — 1) (2s—3)...1 


E (rir) = (n+ 2) (n+4)... (n+ 28+ 2)" 





The procedure for 0*¢/06? is similar but more complicated, giving 








OG] fae +6) & 4443) (4944)... G+ H+)... 0 
[Palau “aap 23 e+e jl 2a (i+ 26845 +N), 








o———_ 





the 


ner: 
7:2) 


and 


(7-3) 


and 


yn, it 


2", 








G. M. JENKINS 415 
which results in 


_ (n+ 4(92 +5 +1)] (27-1) (2j-3)... 1 
Sear) = (n+2)(n+4)...(n+2j+4) 





There is no point in proceeding any further, since these results are identical with those 
obtained from the constructed distribution. 
It will be shown in the next section that the smoothing process always leads to correct 


moments for the serial correlations up to order ; it may thus be inferred that the same is 
true of the constructed distribution. 


8. THE NATURE OF THE SMOOTHING OBTAINED 


It is now important to consider the exact nature of the smoothing achieved in the joint 
distribution p(r,, 7.) and how this reflects itself in the distribution of v. 

In essence, the smoothing process involves the replacement of the exact characteristic 
function i 


d= exp| 5 z log {a +6 cosa -+c0s 2a}! , (« = — 
2K=1 | n 


by the smoothed function 
‘ln 
é = exp |-z| log {a+b cosa+ccos 2a} da] , 
0 


As was pointed out in § 5, the calculation of the exact moments reduces to the problem of 
evaluating the series 
2rk  4nk 


n 
> cos*— cos‘ — 
k=1 n 


It is now observed that in the case of the smoothed form, the moment problem is resolved 
by the solution of the integrals 


n 2n 
— cos* a cos’ 2ada, 
4n 0 


and, in fact, the expressions given for the series in § 5 are only true for max (s, t) <n, whilst 
they represent the value of the integral for all values of s and ¢. It thus follows that smoothed 
moments will agree with exact values provided this condition holds. The result of this 
procedure is to replace a function which is represented by different analytic forms in the 
various regions of the (r,,7,) plane by a single function defined over the region. 

As far as the smoothing of the distribution of v is concerned, method 3 of §6 illustrates 
the fact that the first moment of v depends on all moments of the form &(r#*r,) of the 
smoothed joint distribution. Since the latter are correct up to order n only, the first moment 
of v is not exact. However, the agreement will be very close, the moments differing from 
their exact values by quantities of order n~*, where r itself is very large. 

In an analogous manner it may be shown that in the case of the Leipnik distribution for 
r, in a Markoff scheme, namely, 


PAT, |) = [B(d, d+ 3)J* (1-1) {1 + — 2a ry}, 








1 2 (fn4+j—1)!/ 20, \i_, 
that & (ry | oy) - (a + aayin (4n—1)!j!. | j+1 
where Kjxa = E(r4** | x, =0). 
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Since the latter are correct up to order 7 only, the same state of affairs obtains as in the case 
of v, Similar remarks may be made about the distribution of 73), although the situation is 
not identical. It thus appears that whilst we may he able to smooth the joint distribution 
of serials, the moments of various functions of the latter may not agree with the exact 
values. Since the agreement is so close, the distributions of such functions may themselves 
be regarded from a practical point of view as smoothed distributions with high order 
moment agreement. 


9. MODIFICATIONS WHEN THE SERIALS ARE CORRECTED FOR THE MEAN 


In practice, it is only very rarely that we know the theoretical mean of a time series to be 
zero. It ths becomes necessary to define a circular serial correlation coefficient corrected 
for the sample mean by 

n 

X (%;—%) (44-2) 


7, wa t=1 





> (x,—2)* 
i=1 


As in the univariate case, this procedure results in a complete loss of mathematical sym- 
metry and the expressions for the moments are complicated. 
It may be shown that the joint characteristic function of 


a I 2 y ed ae at ed ae 1 = a 
p= 208 (%,-Zz?, G= o8 2 (%;—Z)(%j41-Z), = re) (%;,—2) (%42—2), 


n-1 —t 
is given by Go; 81,92) = i (2 —6,—, cos = — 6,008 ae ‘ 


The method described in § 5 is now immediately applicable, but it has been found convenient 
to modify the technique slightly. Using the same notation as in § 5, it follows that 


1s Lis (3 
GOO, 2ym4 4): 


od aa or-1 orl a 
so that er ~ BR [5 2 4 ’ 


and the latter may be evaluated using Leibnitz’s theorem for the nth differential of the 
product of two functions. Since 


worl (a)]-¢-'2 (2) 


(r—1)! r—1 10g n-1 (3). 


it may be shown that 


og 
a a mieth bad 9-1 
065 2 420 9! Of xo (91) 


A 
The values of the trigonometrical series may be obtained without further calculation, since 


"S arf = F arfe—1. 
k=1 k=1 
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The moments may thus be built up systematically and the following results were obtained: 











; 1 

Pu 2_]’ 
, n—3 

Yai = (a1) (n +1) (n +3)’ 
; 3(3n +5) 

M31 ~~ (1) (n+ 1) (n +3) (n +5)’ 
3(3n? + 16n— 35) 

Ma = (1) (n+ 1) (n+ 38) (n +5) (n +7)’ 
: n2+4n—15 

422 = 





(n—1)(m+1)(n+3)(n+5). 

When it comes to the evaluation of the moments of 3, the following factors must be borne 
in mind: ; 

(1) No smoothed form for p(7,) exists, and it is thus necessary to resort to a two moment 
fitting of a Pearson type I curve. 


(2) The assumption of independence of 7, and @ is not tenable, since it leads to 
incorrect bivariate moments. 


At this stage we can do no more than indicate the effect which the component Z exerts 
on the distribution of %. 


It is possible to obtain approximations to these moments by using the expansion 


1 te i 
l-v = —;>-— r a 
l—r 2 ve 


Since &(rz/r,) is of order n-/-!, a good approximation to &(v) may be obtained by con- 
sabe 1 8(v) #6[(1- 191] - (74) —E(r8r,) 


and expanding the right-hand side in powers of l/n. For &(v*) an analogous method is 
available by considering 


(1—v)* = (119) 2g +19 + (08 2r) 5S rh 
j=1 


If this procedure is applied when the serials are not corrected for the mean, the values 
obtained for the first two moments of v coincide with the smoothed values derived previously . 
When the serials are corrected for the mean, it was found that 


Compared with the moments when no mean correction is made, it is seen that whereas the 
variance is slightly altered, the mean is approximately doubled. The experimental results 
in the next section tend to support this conclusion. 

Dixon’s results on the criterion 1 — %? show that the even moments of 0 are obtained from 
those of v by replacing n by n — 1. This effect has appeared in all distributions yet considered 
in the field of serial correlation, whilst correcting for the mean has a big effect on the odd 


27-2 
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moments. Moreover, smoothed distributions are no longer available when a mean correction 
is made. It seems reasonable to suggest therefore that if the squares of the correlogram and 
the partial correlogram are used instead of the correlograms themselves, tests of significance 
will be available which are independent of the theoretical mean of the series. 


10. APPLICATIONS TO ARTIFICIAL TIME SERIES 


The distributions considered have been those under the null hypothesis of randomness. In 
testing a Markoff scheme against a Yule scheme, for which v is the appropriate statistic, the 
null hypothesis is that the series follows a Markoff process. 

By an application of a theorem due to Madow (1945), it is seen that the smoothed joint 
distribution of r, and r, in a Yule scheme is given by 


PTs, % 2 | ys %—) = P(r, 72) {1 +a + af — 2ory(1 — ag) ry — 2aegrg}™, 
where p(r,, 72) is the distribution when «, = 0 = a. Transforming gives 
P(r, 0 | &y,%_) = pry) p(v) {1 + af + af — 2ee,(1 — ay) 7, — 2a,0(1 — 77) — 2argr7}-*, 
where P(?y) = P(r, |%=0=a), p(v) = p(v| a, =0=a,). 
In an exactly similar manner it follows that 


P(r, | %) = p(r;) p(v) {1 + af — 2a, 7,}-” 
= p(r1 | %1) d(2), 


which exhibits the fact that the distribution of v is the same in a Markoff scheme as in a 
random set-up. In the case where the serials are corrected for the mean, it seems that this 
will be very nearly true and the experimental results tend to confirm this. 

Sampling experiments have been performed on the distribution of v in a Markoff scheme 
and a Yule scheme by Quenouille (19496). From an analysis of several artificial series it 
was found that &(v) is always negative. This was termed ‘bias’ and artificial methods were 
used to remove this bias. This procedure is now seen to be unnecessary, since this effect may 
be explained by means of the distribution theory. 

The following results, which are taken from the same paper relate to the mean and 
variance of v estimated from thirty subseries each containing twenty members, from a 
scheme which is approximately a Markoff process with a, = 0-6. 

A circular definition was employed and the partial coefficients were calculated: 

(1) Uncorrected for the mean. 

(2) With a mean correction. 





(1) (2) 





&(v) Observed —0-0489 —0-1443 
Expected —0-0476 —0-1052 
Var. (v) Observed 0-0313 0-0411 


Expected 0-0451 0-0444 
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The agreement between observed and expected values is good except in the case of &(v) 
when the serials are‘corrected for the mean. It is hoped to provide further illustrations of 
the sampling distribution of v at a later stage when non-central distributions will be con- 
sidered. 


Finally, I am greatly indebted to Dr F. N. David and to Dr N. L. Johnson for their advice 
and encouragement during the preparation of this paper. 
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SOME PROBLEMS OF OPTIMUM SAMPLINGT 


By PAUL N. SOMERVILLE 
Institute of Statistics, University of North Carolina and Virginia Polytechnic Institute 


1. IntTRODUCTION 


An experimenter is asked which of k + 1 populations has the largest mean and must decide 
how large a sample he should take to decide this question. Taking a large sample decreases 
the probability of an incorrect decision, but at the same time increases the cost of sampling. 
It seems obvious that the ‘optimum’ sample size should depend both on the cost of sampling 
and the amount of use to be made of the decision. 

In this paper, loss functions are set up which take into consideration the amount of use 
to be made of the result, the cost of making a wrong decision and the cost of sampling. 
A theorem is proved which, under certain restrictions, enables us to find a maximum of the 
expected loss over all possible parameter values, the parameters being the means, variances, 
etc., of k+ 1 otherwise identically distributed populations. It is then possible to minimize 
this maximum loss with respect to the sample size. Results are given in the case where the 
parameters are means, and where the sample means are assumed to be normally distributed. 


2. ‘OPTIMUM’ SAMPLE SIZE USING MINIMAX PROCEDURE 


Suppose we have k+1 populations Ip, II,,..., I1,, identically distributed except for un- 
known real-valued parameters 6,>0,>...>0,. We wish to conduct some preliminary 
sampling procedure which will select the population with the largest} parameter, with the 
purpose of using it for a further ‘sample’ of size N. Let W(0;,6,) be the loss incurred in 
selecting the population II,;, where W is a real-valued function with continuous second 


derivative. Let W(9; 4) aaa 0, WG, >) > 0. 
(There is no loss in generality in setting W(8,,9)) = 0, since we can always put 
W(6,, 9) = W(4;, 90) 7 W(4%; 9.).) 
Let a sample of size n(k +1) be taken by an arbitrary procedure—one-stage, two-stage, 


etc. Let O(n) be the cost of a sample of size n(k+1), where C(n) is a real-valued function. 
Let p; be the probability that the population II, is chosen. Then, the expected loss is 


k 
L= 2 W(9;, 9) p,+ O(n). (1) 


The two theorems which follow are of a general nature and are intended to help in the 
determination of sets of parameter values which maximize L. Theorem 1 shows that given 
65, @ maximum of L may occur when 6,,6,, ...,0, have a common value 9’, which will in 
general depend on 4). Theorem 2 shows that if each W(0;,0,) depends on a function 
9; = 9(9;, 09) and each p, can be expressed explicitly in terms of these g,’s, then a maximum 
of L may occur when g,, 9, ...,g, have a common value g’, independent of 04, 

t This research was done under a U.S. Air Force Contract, in part, monitored by the Office of 
Scientific Research. 

} There is no essential difference in the problem of choosing the largest parameter and that of 
choosing the smallest parameter. 
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THEOREM 1. (a) For any given 6p, if 0; = 0 (i = 1,2,...,%), then 
oL ol... 
30, 00; @j= I, 2, 0058) 
(6) If there is a value @’ such that 0L/00;]o,¢ = 0 (j = 1,2,...,%), where 0, = 6’ holds 
for all i = 1, 2, ..., k, then, if 


OL 
eL —1 06,06, 
ser al pet ee 
Ble <° and En1~< Br <1, 
063 =’ 


for all j and m, a maximum of L exists at this point. 
Proof of (a). It follows from ee, (1) that 


OL ) ’ 
29, = 0,60) P+. z WG, Odean (f= 1, 2.58). (2) 


. Bee ' oe ape coe 
Since =P: = 1, we have = 36, 20, “<a, (j = 1,2, ...,&), 
and therefore 
oL Op Aap 
— = W’'(6,0 — W(0,0 ste »j =1,2,...,&). 
Bilao W'%%02,),_— W10.0) Blo 3 ) 


But, if 0; = 6; (i,j = 1,2,...,&), we have by symmetry, 


Di = P; = p (say) = (1—po)/k. 
— op oe ‘ge 
Similarl oe 3 an 1,2, 3M. 
meas 20; leno Dmlono “7 
aL aL 
Theref: 5 3j,m = 1,2,...,%). 
refore O,lon0 OOmtone °™ ) 


Proof of (b). Proceeding from equation e we find 


a0, ath, = P10) Ps 8im+ WO Oo) hE + W' Oy 04) e+ ¥, WO, 80) 5 5h 
where 6;,=0, t+7 Nod 6,, = 1. 
Putting 0; = 0’ (t = 1, 2,...,%), and using considerations of symmetry, we have 
aT 
FO, (2 400Ps 8m +2000) BE] — WOO) 55 oe], 
We shall have a maximum if and only if the matrix of al partials of L with respect 
to 0;, 6,,, evaluated at 0, = 0, = ... = 6, = 0’, is negative definite. 
The matrix of the second partials may be written 
78 paid 
eL ee eL 
wl . - 58 Naot say, 
lls 2 1 
OL 
where r= sa ae 
oL 
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Now the determinant of A, can easily be shown to have the value fh e (k—1)r]{l—r}*, 
from which it follows that (A ,) is definite (and positive) if, and only if, as * <r<1. Therefore 


G | 
ae A 
063 Le k) 
is negative definite if and only if eb 

eL —1 06,00 

a qo < el 

lee <° and E-1* BL <1. 

064 =’ 


Let there exist a function g = g(9;,0) = g; (say) such that 
= Pi(Oq, 94; ---» x) = De(Yas Ga» +++ Iu)» 
Then, if W(0;,9,) = W(g,), we have 
TuroreM 2. (a) Ifg; = g (¢ = 1, 2,...,&), then 


oL oL 
== — (,j =1,2,...,k). 
og, Og; $i , 
(6) If there is a value g’ such that 
| ‘ 
= =@ (j= 1,2,...,&), 
09; oi=7 . 
eL 
. eL << 242m 29; OF n 
then if alee <0 and — <a ZL <1, 
0g} a=9' 


a maximum value of L exists at this point (i.e. independently of ,). 

Proof. The proof is the same as the proof of Theorem 1 with 6; replaced by g;, and 
W (0;, 4) replaced by W(g,). 

Assuming that the g,’s exist, we have 


k 
L= 2 W(9,)p,+C(n), 


oL . 
9; = W’ 95) P5+ | > Wane! (j ” 1, 2, --+yk), 


eL ey Hint OPS. _ wat Obe che 
29,00 Soy W"(9') 08 m+ 2W'(g yee] W(g )g,0g bi (,j,m = 1,2,...,k), 
where, as before, 6;; = 0 (t+) and 4,, = 1. 

Theorem 2 enables us to find a maximum of the expected loss over all possible parameter 
values. We have not proved that this maximum is the only maximum, nor even that it is 
the largest maximum. As a matter of fact, it is possible to imagine functions W which could 
yield more than one maximum. However, in the case where the unknown parameters are 
means or variances of normal distributions, and the W’s are function of the type c,(0.—9,)*s, 
c, e°%.-%) or other seemingly ‘reasonable’ loss functions, calculations lead one to believe 
that the maximum will in fact be unique. 


The above maximum loss can then be minimized with respect to the preliminary sample 
size. 
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3. ONE-STAGE SAMPLING FOR MEANS 
Suppose, as in §2, that we have k+1 populations Il), II,,..., [,, identically distributed 
except for unknown means 0) >0,>...>0,, and with the second moment of II; about 6; 
equal to o*. It is desired to use the population with the largest mean for N occasions. A pre- 
liminary sample of n is taken from each population, with the object of deciding which 
population is II). The N individuals are then chosen from the population yielding the largest 
preliminary sample mean.t} As before, let C(n) be the cost of taking the preliminary sample, 
and W(0;,05) be the loss incurred in choosing population II;. Let %; be the mean of the 


sample from II,, and let p,; be the probability that the sample from II, will have the largest 
mean. The total expected loss is thus 


k 
L= 2 W(G,, 4) + C(n), 


where p, = Pr {i <%;, wong Dey < By, By < Xz, woe By < Hy} @= +~ ae | 





6,-—8, 
Let 9; = mz + (4n)t, 


f(x, .--,%) be the multivariate normal frequency function with variances equal to 1 and 
covariances equal to 4, and let F(a,,...,a,,) be the integral of f(x, ...,z,) over the region 
—0<2,<a,; (i = 1,...,k). Then, if we assume 7; is normally distributed (which will usually 
be a reasonable assumption even when the populations IT; are non-normal), we can show that 

Po = F(Q1, ---»9x)s 

Pi = F-94919 00+) — GAG» — Go ~GtGisw-- —HFGe) (6 = 1,2,...,%). 

If our object is to make as large as possible the expected value of the N individuals, 
then a reasonable loss function would seem to be 
2\% 
1 (8.04) = (G8) = Noy)(-) = Wai) 

Using this, and putting g; = g (see Theorem 2) (i = 1, 2,...,k), 


+ 
G. kNogp;() +C(n) 


= No(-) 9 — Po) +C(n). 


Theoretically, the value at which the maximum occurs can be found by solving 
eL 
Tilers; 1, 
However, practically, it seems easier to evaluate L for various values of g, and using methods 
of finite differences, obtain the maximum value of L with respect to g in that manner. 
Using the generalized Mehler Series of Kibble (1945), F(g,, ...,g,) has been’calculated for 
k = 3,4, 5. Results are shown in Table 3-1 along with results for k = 1, 2, which can be found 


in Karl Pearson’s (1931) Tables for Statisticians and Biometricians, vol. 1, Table II and 
vol. 2, Table VIII respectively. 


+t This procedure is justified by Bahadur (1950). 
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Using Table 3-1 and Salzer (1948) Tables of Coefficients for Obtaining the First Derivative 
Without Differences and the Laplace-Everett central-difference formula, the maxima of 











g(1—ppo), and the maximizing values g’ = g, = ... = ...g,, were calculated and are shown 
in Table 3-2. 
Table 3-1. Multivariate normal integral 
Gg ¥, 
v F(z) F(x, x) F(x, x, 2) F(x,x,2,x) | F(x,x,x, 2,2) 
0-0 0-50000 0-33333 0-2500 0-2000 0-167 
0-1 0-53983 0-37408 0-2875 0-2341 0-198 
0-2 0-57926 0-41623 0-3275 0-2714 0-232 
0-3 0-61791 0-45931 0:3697 0-3117 0-271 
0-4 0-65542 0-50282 0-4137 0-3544 0-312 
0-5 0-69146 0-54625 0-4586 0-3990 0-356 
0-6 0-72575 0-58906 0-5040 0-4449 0-401 
0-7 0-75804 0-63079 0-5491 0-4912 0-447 
0-8 0-78814 0-67098 0-5935 0-5373 0-494 
0-9 0-81594 0-70922 0-6364 0-5827 0-541 
1-0 0-84134 0-74520 0-6777 0-6269 0-587 
1-1 0-86433 0-77866 0-7169 0-6695 0-632 
1-2 0-88493 0-80941 0-7536 0-7100 0-675 
1-3 0-90320 0-83734 0-7876 0-7481 0-716 
1-4 | 0-91924 0-86243 0-8186 0-7834 0-754 
1-5 0-93319: 0-88471 0-8466 0-8155 0-789 
1-6 | 0-94520 0-90427 0-8715 0-8443 0-821 
1-7 | 0-95543 0-92124 0-8934 0-8699 0-850 
1-8 | 0-96407 0-93581 0-9124 0-8923 0-875 
1-9 | 0-97128 0-94817 09287 0-9119 0-897 
| 
2-0 | 0-97725 0-95855 0-9425 0-9286 0-916 
2°5 0-99379 0-98825 0-9832 0-9785 0-974 
30° | 0-99865 0-99736 0-9961 0-9951 0-994 
| 























Table 3-2. Maximum of g(1— po) 

















k Maxg(1—p») | g’ 

g } 
1 0-169971 | 07518 
2 0-2634 0:8238 
3 0-3274 | 0-878 
4 0-376 | 0-92 
5 0-414 | 0:95 





Note that we have not yet demonstrated that we have a maximum of L and not merely 
a stationary point. By Theorem 2 we will have a true maximum if 





| 
— = G,(9') < 0, 
09% Joo" va) 
eL 
—1 _%,0 , 
and mis ee = G,(g') <1. 


093 ai=9" 
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By calculation, we find the following values for G,(g’) and G,(g’) when g(1 — p,) is maxi- 
mized. Thus the conditions of Theorem 2 are satisfied, and we have actually demonstrated 
the existence of the maxima. 








Table 3-3 
k G,(9’) G9’) 
1 —0-4315 _—- 
2 — 0-343 —0-115 
3 — 0-291 — 0-091 
4 — 0-252 —0-07 
5 — 0-22 — 0-06 

















Let M, be the maximum of g(1 — 9). Then 
+ 
- maxL= Now,,(-) +C(n). 
9g 


Let the cost of taking the preliminary sample be a linear function of the sample size, i.e. 
C(n) = ¢.n+Co. Minimizing this maximum with respect to n, we have 





= = —2-+NoM,n++<, 
: c, /2 
- no oh ee 
. Se 
M,\! 
ie. if ~e (=) Nt. 
¢/2 


This means that the optimum n is proportional to N#, a result noted by Robbins (see 
also Bross, 1950) for the special case of k = 1, that is, for two variates. 
The expected loss at this value of n is 


oM,\-+* oM,\* 


= 2-tot M}ct N24 1] +0, = 23811 Motch Nt + cy. 


It is worth noting that one-third of the maximum expected loss (neglecting cy) is due to 
sampling costs and two-thirds due to loss from choosing the wrong population. This 
maximum occurs where 

2 


-6,=6 = (-)'ov = 2tclotM;;* N-tg’. 
We may then construct Table 3-4. 

As shown in the table, the maximum value of g(1 — 9) occurs at values of 6; (such that 
o-1(6, — 6,) = 2(c,/No)*) which are not usually improbably large. In other words, it is quite 
possible for the maximum possible loss to occur, and thus our minimization of the maximum 
appears reasonable. 

It will be noted that the optimum sample size as expressed is an explicit function of the 
use to be made of the sampling result, and of the sampling cost per unit. Further, the loss 
per unit is proportional to N-+. Thus, as N increases, the loss per unit decreases. This is in 
contrast to the usual manner of selecting sample size where a minimum 4 which it is desired 
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to detect, and a probability # of detecting this 3, are set up. In the latter case, the selected 
sample size is a function only of the # and 4, and the loss per unit is fixed. 

It should be stated that we have not proved that the maximum we have obtained is a 
unique maximum, but only that it is a local maximum. In case the populations are normal, 
and using our W, it is easily proved that the maximum is unique for k = 1, and for 
k = 2,3, 4,5 sufficient calculations have been made that it seems the maximum is unique. 


Table 3-4. Values of M,, n, L— co, 99—9; for minimizing the maximum expected loss 








F Value of 6,—6; 
Optimum n 80% eapenet at which 
k M, (multiply by (m ultiply by —. — 
otcytNt multiply by 
— otciN#) oic}N-+) 
1 0-16997 0-24354 0-73062 2-154 
2 0-26344 0-32617 0-97851 2-05 
3 0-3274 0-3767 1-131 2-01 
+ 0-376 0-412 1-24 2-0 
5 0-414 0-43 1-3 2-0 























It is possible to use different W’s such as 
Co(Ao—9;)", Cy eo", eto. 
From calculations, it would seem that for normal populations the maxima obtained are 
unique in these cases also. 


Suppose we wish to choose the population having the largest mean but are concerned only 
with detecting a difference at least as great as 0. 


Suppose also that we consider any differences greater than or equal to 6, equally un- 
desirable. We may put 
W(6;,05)=1 if @—-0,>6 
=0 if -0,<é (¢=1,2,...,k). 
Bechhofer, Dunnett & Sobel (1954) consider this problem, finding the smallest sample size 
n which will detect the largest mean with probability at least 1—. 
Using the above function for W, and assuming the sample mean from I]; is normally dis- 
tributed, it is not difficult to show that there exists a value 6, = 6, = ... = 0, = 0(=0@)—4) 
for which L is a unique maximum. The expected loss from choosing the wrong population is 


k 
L*= 2 W819 0) Pi. 


Suppose 6,-6;,<8 (¢ =1,2,...,m), 


4-9,26 (¢=m+1,m+2,...,k). 


Therefore L* = Pings + Pmt +» + Dye 


Differentiating L* with respect to g,, it is easy to show that L* is an increasing function of 
g; for i = 1,2....,m, and a decreasing function of g; for i = m+1,m+2,...,k. Thus, L* is 
a maximum (uniquely) where 


6-6, =6 = 1, 2,...,&). 
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It is interesting to examine the consequences of not sampling at all. Suppose that we are 
willing to state that 0, >0,, 04< 0,, where 0,, 0, represent the smallest and the largest means 
we can imagine the population to possess. Then the maximum expected loss by not sampling, 
ie. choosing a population at random, is 


k 
N(O,-9,);—- 


Now the expected loss at our minimax n is 
2-3811 Mj otc} Nt + cp. 

If the latter expression is larger than the former, then it seems reasonable that we should 
not sample at all. This might occur when the cost of sampling is high, either because of the 
initial cost cy, or the additional cost per unit sampled c,, or where N is small. An example 
might be a manufacturer who is to produce an expensive product which will have a limited 
use. To sample by trying out two or more methods of production, or variations of the same 
product, might be extremely expensive compared with the amount gained by using the 
improved product. 

It is also of interest to examine the consequences of not using the minimax n, but 
instead rn, where r>0. Our maximum expected loss becomes 

L = 2-+o4 Mh ct Ni2r-* +r] +c. 

Neglecting co, L is increased in the ratio }(2r-++r). For 0-5<r<1-8, the maximum L is 
then increased by less than 10% of its value at r = 1. Thus, if the experimenter uses as 
little as one half the minimax , he will increase his maximum L by only 10%. However, 
instead of one-third of Z being due to the cost of sampling, and the remainder due to the 
loss in choosing the wrong variety, now 0-18 of the loss is due to the cost of sampling, 
and 0-82 is due to the loss in choosing the wrong variety (again neglecting cy). If r becomes 
smaller than 0-5, the maximum L increases very rapidly. 


4, TWO-STAGE SAMPLING FOR MEANS 
Suppose we have three normally distributed populations Ip, II,, Il, with variances o? 
and unknown means 6, > 0, > @, respectively. It is desired, as in § 3, to choose N individuals 
from II). We are allowed a preliminary sample of 3n to determine which population is I). 
Using the notation of the preceding sections, we write the expected loss as 


2 
L= ¥ W(O;,4o) p,+C(n), 
i=1 


where p; is the probability that we choose the N individuals from II;, and W(6,,0,) is the 
loss involved in choosing them from I];. 

Let us suppose we take a two-stage sample as follows: 

Take a sample of size n, from each of the three populations. Discard the population having 
the smallest sample mean in the first stage, and take a further sample of n, from each of the 
two remaining populations, where 3n,+2n. = 3n. Choose the N individuals from the 
population having the largest cumulative sample mean. 

Let p; be the probability that the N individuals are selected from II;. Then it can se 


shown that =», = F(ago, 91-92, 91; A) + F(2G1; J2—9u» 92: A); 
= F(a[g2—91}, — 92, —913 A) + F(—291, 92, 92-913 A), 
Pe = F(alg,—Gel, —91, —9e; A)+F(—a, 91; 91-92; A); 
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6,—0 +n.\* 
where 9% Sige (3n,)', a= (™E") ’ 
and F represents the integral of a multivariate normal frequency function with variance- 
covariance matrix A given by 


IY 
Rh & 
int 

A=[> 1 
1 
Be oh 
As in §3, we put W (8,9) = N(0,—9,) 


2\% 
= Nog(=) ‘ 


Thus, by Theorem 2, we know that a maximum of L occurs for some g’ = g, = g, provided 
the conditions on the second derivatives are satisfied. 





; 2\t 
Putting =.= 9  L= 2Nog(1—p)(—) + O(n. 
Further, since 3n = 3n,+ 2n, and (n,+,)/n, = a?, we have 
a m 21 
m1 Qat+1’ ny a?—1” 
241\# /2\4 
Thus Ls n(= + *) (-) og(1— pp) +C(n). 


It will be noted that L here differs from the L in the one-stage procedure only in the factor 
(2a? + 1)#/,/3, which is equal to one in the limiting case a = 1, where the two-stage sample is 
actually a one-stage sample. 


Again using the generalized Mehler series of Kibble (1945), we may evaluate pp, and thus 
— M = max [}(2a* + 1)]* 9(1—pp), 
g 


obtaining the results shown in Tables 4-1 and 4-2. 

Graphing the results in Table 4-2, it is seen that the two-stage sampling procedure has 
a smaller maximum expected loss than the one-stage procedure using the same total sample 
size, provided 1 <a < 1-92. The smallest maximum loss occurs where « = 1-35. 


Table 4-1. Values of py = 2F (ag, 0,9; A) 








apn 1 1-2 1:3 1-4 1-5 1-8 1-9 
03 ave =: 2. az x = = 
0-4 ice ba eae 7 0-5677 0-6060 0-6168 
0-5 pa on 0:5992 0-6141 0-6299 0-6702 0-6822 
06 gt 0-6318 0-6509 0-6686 0-6854 0-7292 0-7418 
0-7 0-6308 0-6789 0-6999 07207 0-7370 0-7815 0-7940 
0:8 0-6710 07232 0°7455 0:7687 = i les 
0-9 07092 0-7643 an en = ait wen 
1-0 0-7452 pn ie > aaa pine fort 
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Table 4-2. M = max [3(2a?+ 1)]#g(1—p,) 
g 











| 
a 1 1-2 1-3 1-4 1-5 1-8 1-9 
M 0-2634 0-2558 0-2547 0-2547 0-2556 0-2607 0-2632 
Max at g = 0-834 0-710 0-657 0-614 0-594 0-521 0-503 
































Since n,/n, = («?—1)-1, we have the result that the two-stage sampling procedure has 
a smaller maximum expected loss provided 0-37 < n,/n,.<0o and the maximum is smallest 
where n/n, = 1-22. 

Suppose we equate the maximum expected losses for the one- and two-stage procedures 
by adjusting the total sample size for the two-stage procedure. 

Let n* be the total sample size for the two-stage procedure, and put n,/n,= 1-22. Equating 
the maximum expected losses, we obtain 


0-2634/nt = 0-2546/n** or n*/n = 0-934, 
ie. we effect a saving in sample size of 6-6 %. 


We have not yet shown that we have a maximum of Z and not merely an inflexion point. 


However, an extremely lengthy piece of algebra confirms that condition (b) of Theorem 2 
is in fact satisfied. 


This research was suggested by Dr H. E. Robbins. The author is indebted to Dr N. L. 


Johnson for his encouragement and valuable suggestions and criticism during the course 
of the work. 
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A TEST FOR MARKOFF CHAINS 


By PAUL G. HOEL 
University of California, Los Angeles 


1. InTRODUCTION 


By proving the asymptotic normality of certain frequency counts in Markoff chains, 
Bartlett (1951) was able to construct a likelihood ratio test for the goodness of fit of such 
chains. His test is designed to test whether a sequence of observations is at most r-depen- 
dent. In it he assumes that the transition probabilities are known, or at least depend upon 
a limited number of parameters which can be estimated. If the transition probabilities are 
completely unknown, a different test is needed. It is the purpose of this paper to present 
such a test. The derivation depends heavily upon Bartlett’s results and methods, and is 
essentially a modification and amplification of some of his methods. 


2. DERIVATION 


Assume that a sequence of observations x,,%,...,%,, can be treated as the sample values 
of a Markoff chain of order r or less, and consider the problem of testing the hypothesis H, 
that a chain of order r—1 will suffice. More precisely, if p;; _,, denotes the transition pro- 
bability for an r-chain, the hypothesis to be tested is 


AL: Pig ...td = P54 (¢ = 1, 2,...,8). 

By a chain of order r is meant a chain in which the dependence extends over r+ 1 con- 
secutive variables only. For such a chain there will therefore be r+1 subscripts in the 
transition probability p,; jy. 

By choosing r sufficiently large to include any reasonable model, it is possible to test 
successively lower orders until an order is reached below which it is unreasonable to go. 
Such a test essentially determines the order of the dependence. It is not capable of testing 
the adequacy of the Markoff chain assumption itself with respect to such things as the homo- 
geneity of the sequence, etc. This criticism also applies to Bartlett’s test. 

The test that will be constructed is an asymptotic version of the likelihood ratio test for 
composite hypotheses. Now, following Bartlett, the likelihood function is, except for 
neglected beginning terms, given by 

L= ; Il Pidecdee (1) 
where the indices range from 1 to s, corresponding to s possible states, and where n;;__ 4 


denotes the observed frequency of the r-chain state ij...k1. The maximum-likelihood 
estimate of p;; 4; is 





i nN 
, i. (2) 


8 
where ”;; = > %;,..4- Using primes to denote parameter values under Hh, it follows 
i=1 
from (2) that 
75 oo (3) 
Le 





Ar an Aw 
Pj... = Pj = 
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The likelihood ratio for testing H, then assumes the form 
y — Polmax.) — LPs...) a 
L(max.) — L (Pj; 1) 
Bartlett (1951) has shown that the n,;__,, are asymptotically normally distributed under 
mild regularity conditions; hence, assuming those conditions, 
Lee | A |* e—tn—p) A(n—p), (5) 
Here [n — 4] denotes the row vector and (n — 1) the column vector of the linearly independent 
variables n,;__4y—/44;...4 Where 4;;  ,, is the expected value of n,;__,;. This notation is used 
in place of the customary prime notation for transposition because primes are being used 
to denote values under H). The positive definite matrix A and the vector « are functions of 
the parameters p,; _ .. Applying (5) to (4), A will assume the asymptotic form 
a | A’ |# etn 14%?) 
| A |# e-Hln—Aldin—A) ; 





A 





where fi, 4 and ji’, A’ indicate that the parameters p,;_j, have been replaced by their 
maximum likelihood estimates D,; ,, and pj; 4, respectively. Consequently, 
4 Ar , aA Aw A 
~2logA~log eh +in— A114 nA )—[n—p] A(n—f). (6) 
When 4A, is true, D,; 4, and $j; ,; both converge stochastically to p,; jz. Since it is 
easily seen that | 4 | converges stochastically to | A |, it follows that | 4 | and | 4” | converge 
to the same value; hence (6) reduces to 
—2logA~[n—p'] A"(n—j’)—[n—p] A(n—8). (7) 
That the second quadratic form in (7) vanishes may be shown in the following manner. 
The typical term in the vector [n —] will be denoted by ;; _..—/i;...4- Since 


Miya = E155...) = MP... Pig... 
where P;; _;, denotes the absolute probability of obtaining the r—1 chain state 7... k, it 


follows that -” x ny 
Bis ta = MP a5 Dig tae (8) 


P;;.., is some function of the transition probabilities p;; jz. This relationship will be 
indicated by writing P;;_. = 9(i;...m)- Then by P;;__;, is understood the value 

Pigs. = Dis...) 
Assume for the present that the value g(,;__ ;z) reduces to 
4... 
n 





9(Dis...xa) = - (9) 


Then (8) reduces to Riy..w = ny ident ij... 
nm Nye 


The typical term in the vector [n — #1], whichis n;;__ 4.—/2;;...., therefore vanishes. Asa result, 
the quadratic form [n— jz] A(n — 72) vanishes and (7) reduces to 


—2logA~[n—i'] A"(n—7’). (10) 
Now Mig... = WP 35 RP ig... ta 
= 09 (D5... x1) Pj... ee 
Consequently, Bis..1a = (Dj... 1a) D5... 
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As in the case of (9), assume for the present that 9(},_, ,) reduces to 





A nN 
(By...) = “t=, (11) 
ar n n. 
Then Pij...a = —_— iB, 
Gok 


and therefore the typical term of the vector [n—z’] in (10) becomes 


a! Oe BO _ (12) 
5k 
It is necessary to determine the number of linearly independent variables of the type (12) 
in (10) before the distribution of (10) can be determined. Since there are s’ — 1 independent 
restrictions of the type nt ” 
2 3. = 1. = 2 5... kat 


25 .kl = Nig. 


the n,; 4, with / = s. The variables z;; __,, in (12) therefore do not include / = s. But from 
(12) it is clear that > 2...4 = 0. Since these restrictions on the 243... hold for all values of 
i=l 


j, ---,k, but only for / = 1, ...,s—1, there are s’-1(s— 1) restrictions on the z,; _,,. Thus, the 
quadrati form in (10) can be expressed as a quadratic form in 
gr tl — gt — s*-1(g— 1) = s"—1(s— 1)? 
variables. 
Since n,;__,/”;.., converges stochastically to p,,__,, the variables z,;_,. given by (12) 
will possess the same asymptotic distribution (Cramér, 1946, p. 254) as the variables 


Wig... = Mga Pig. da 
But since w;;__ ,,is a linear combination of the n,;__,, the variables w,; __ ,, will be asymptotic- 
ally normally distributed. It is easily seen that they have zero means. The quadratic form 
in (10) therefore has the same asymptotic distribution (Mann & Wald, 1943) as the quadratic 
—_ [w] B(w), (13) 
where B denotes the positive definite matrix corresponding to A in (5) after the linearly 
dependent variables in (12) have been eliminated. Since (13) is a quadratic form in s’-1(s — 1)? 
linearly independent normal variables with zero means and the matrix B is their asymptotic 
covariance matrix, (13) will possess a y* distribution with s*-1(s— 1)? degrees of freedom. 
As a result, the quadratic form in (10) will possess an asymptotic x? distribution with this 
number of degrees of freedom. 
In order to apply the test it is merely necessary to use (1), (2), (3) and (4) to calculate 


—2logA = 2 n (Io Mj... _Jo coed 
g 2, ij...K - ey? 


and treat —2log A as a x? variable with s’-1(s — 1)? degrees of freedom. 





3. ABSOLUTE PROBABILITY ESTIMATES 


In the preceding derivation, (9) and (11) were assumed to be true. The verification of the 
correctness of these intuitive estimates can be made as follows. 
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Since an r-dependent chain can be expressed as a apn sp chain, it will suffice to prove 
(9) and (11) for such chains. 

The relationship between absolute probabilities and transition probabilities discussed 
just after (8) can be expressed by means of equations such as those given by Fréchet (1938). 
These equations may be written in the form 


= PPuv = Py. (14) 


In the reduction of an r-dependent ‘tite to a simple chain, the indices u ota v denote 
r—1 chain states, such as jk ...1. The transition probability p,,, will therefore vanish unless 
the last r—1 indices in u are identical with the first r—1 indices in v. For v fixed, say 
v = jk...1, (14) will then reduce to 





8 
2 is. eP is = Pa (15) 
Replacing 74... by P;;... 2, it follows that 
> Py, ial =P, iy. (16) 
i=1 ij. 


It is easily seen that (9) satisfies (16), and that the solution is unique. 
In order to verify (11), it suffices to place primes on the p’s and P’s in (15) and follow the 
same procedure. Since p;; yy = Pj... x, (16) will now assume the form 
> Pp nN; ... 
Pon 


These equations are easily seen to possess the solution given by (11). 





kl Dp! 
> Poke 
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ON STATIONARY PROCESSES IN THE PLANE 


By P. WHITTLE 


Applied Mathematics Laboratory, New Zealand Department 
of Scientific and Industrial Research 


The sampling theory of stationary processes in space is not completely analogous to that of stationary 
time series, due to the fact that the variate of a time series is influenced only by past values, while 
for a spatial process dependence extends in all directions. This point is elaborated in §§2-4. The 
estimation and test theory developed in §7 is applied in §8 to uniformity data for wheat and oranges. 
The final section is devoted to an examination of some particular two-dimensional processes. 


1. INTRODUCTION 


The disturbing effect of topographic correlation on the results of field experiments, forest 
and crop surveys, sampling surveys of populated areas, etc., is well known, and it is recog- 
nized that we have here examples of two-dimensional stochastic processes. The physicists 
also encounter higher dimensional processes (for instance, in the studies of turbulence and 
of systems of particles) and have indeed been the principal investigators of the subject. 

The processes we mentioned can only as a first approximation be regarded as stationary, 
if they can be so regarded at all. However, the approximation is satisfactory sufficiently 
often to make the study of the stationary type of process worth while. 

Much of the two-dimensional theory is no more than a formal extension of that used in 
the study of time series, so we shall treat these aspects as briefly as possible. There is one 
interesting new feature, however, which is mentioned in the summary above, and we shall 
consider it at length. 

The difficulty of examining particular models is in general greater in two dimensions than 
in one, simply because there are more mathematical obstacles of a technical nature. One 
seems to have left the domain of the elementary functions entirely. We shall indicate these 
obstacles, but take advantage of the fact that for many purposes they may be avoided. 

For many applications it is sufficient to consider only purely non-deterministic processes, 


and we shall restrict our attention to processes of this type, more particularly to linear 
autoregressions. 


2. THE LINE TRANSECT 


It is useful to begin with a discussion of the simple line transect (i.e. a straight line laid over 
an area, along which observations are taken equidistantly). The observations of the transect 
may be regarded as being generated by a one-dimensional process, just as are the terms of 
a time series. However, there is an important difference between the two cases. At any 
instant in a time series we have the natural distinction of past and future, and the value of 
the observation at that instant depends only upon past values. That is, the dependence 
extends only in one direction: backwards. In the case of the transect, however, there is 
no such day and night distinction between the two directions, and dependence will extend 
both ways. We can consider an example for the more general two-dimensional case of a 
field: a dab of fertilizer applied at any point in the field will ultimately affect soil fertility 
in all directions. (Exceptions are of course possible; the field may have so strong a slope that 
only the area on the downward side of the spot will be affected.) 
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Denoting now observation and ‘error’ variates by £,, ¢, respectively (t = ..., —2, —1, 0, 1, 
2, ...), the simplest realistic time series model is perhaps the first-order autoregression 
& = a6) +6. (1) 


For the transect, however, model (1) would have to be regarded as constituting a degenerate 
case, in which dependence extended only in one direction. The simplest non-degenerate 
transect model would be 


E, = a; 1 +b8,,+6, (2) 


where it is intuitively clear that a and 6 must not be too large. We shall term (2) a bilateral 
autoregression, in distinction to (1) which is a unilateral autoregression. 

Consequences of the admission of the bilateral type of scheme become apparent when one 
considers the estimation of parameters. Whereas the parameter a in (1) may be estimated 
consistently by minimizing the residual sum of squares > (£,—a£,_,)?. « x attempt to estimate 

t 


a and 6 in (2) simply by minimizing 
U= py (E;— 98 ;_-4 — 08 ;41)?, (3) 


leads to nonsensical results. One could explain the breakdown by saying that it is not 
legitimate to include &,,, in the conditional mean of £, when the value of &,,, itself depends 
upon £,. Formally, we may say that the Jacobian of the transformation from the ¢, to the &, 
is not unity for relation (2) as it would be for a unilateral relation such as (1). It may be 
shown, however (and in §7 will be proved for the more general two dimensional case), that 
the correct equations for the least-square estimates are obtained by minimizing kU, where 
k is a certain function of the parameters given by 


"(2a 
logk = -5-[ log (ae —1+be-) (ae —1+ be) du. (4) 


3. FORMAL PROPERTIES OF THE BILATERAL SCHEME 


We shall briefly examine the properties of the transect model as a preparation for the 
discussion of the two-dimensional case. Let us consider the general bilateral linear auto- 


regression LT) &, = &, (5) 
where L(T') = a,;T’ and T is the translation operator 

Te, = Si41- (6) 
Equation (5) has the solution £= Ln = 2Lb;€145; (7) 


where b, is the coefficient of e” in the Fourier expansion of [L(e)]- (see Bartlett, 1946, 


p. 60). Using Fourier transforms it may similarly be shown that the spectral function of 
scheme (5) is o%(e) 


Ley Le) am 
(cf. Doob, 1944; Daniell, 1946). The autocovariances 


F(w) = 


P(j) = cov (E45) (9 = 90, +1, +2, ...) (9) 
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are generated as the coefficients in the Fourier expansion of F(w). Thus, writing for con- 
venience e = z, o7(€) = v, we have 
F(w) = 


Stationary processes in the plane 


v 
L(z) L(z-)° — 


It is as well to consider the conditions under which expressions (7) and (8) are valid, since 
a number of essential points are involved. If (5) is to represent a unilateral scheme, expres- 
sing ‘dependence only on the past’, then the Laurent expansion of [Z(z)]-' on |z| =1 
must not involve positive powers of z, and we are led to the usual condition for the stability 
of a time-series autoregression: that all roots of L(z) = 0 fall inside the unit circle (Wold, 
1938). If, however, one is prepared to admit bilateral schemes, then all that is required is 
that [Z(z)]-! possess a convergent Laurent expansion—coefficients otherwise unrestricted. 
The stationarity condition is in this case greatly weakened; all that is required is that no 
root of L(z) = 0 fall on the unit circle. 

While this is the only condition which need be imposed upon a particular L(z) to secure 
stationarity, it is desirable that L(z) be such that in relation (5) it is , which is the dependent 
variate (not, for example, £,,, as would be the case if relation (1) were modified to 
af, = £,,—€,). This may be achieved by multiplying L(z) by some integral power of z (or, 
what is the same thing, redefining the e sequence by translation so that ¢, comes into corre- 
spondence with ¢,). For, suppose that as z describes the unit circle once in a positive direction 
Lz) encircles the origin in the complex plane r times (where r is necessarily integral). The 
normalization will then be achieved by translating the ¢ sequence r steps backwards, so 
that L(7’) is replaced by the normalized operator T-"L(T), or L*(T7'), say. Since the origin 
is not a branch point for log L*(z) (as it was for log L(z) if r was not zero) then log L*(z) may 
be expanded in a Laurent series in z, and the operator L*(7') may be represented 

L*(T) = e247), (11) 


It will be assumed in the sequel that this normalization has been performed, so that the 
representation (11) is always possible. 


4. INDETERMINACIES OF ESTIMATION 


If one is prepared to admit bilateral schemes, then the autoregression exhibits the same 
kind of ambiguity that Wold (1938) has shown to obtain for the moving average. Thus, 
suppose that one is given a set of autocovariances which could have been generated by an 
autoregression of order p, and that one is set the task of determining the autoregression, 
i.e. of determining the polynomial L(7’) of (5). It is thus necessary to find an L(z) which will 
satisfy equation (10), where F(w) is determined by the given autocovariances. Such an 
T(z) may be chosen in anything up to 2? ways, since if a particular L(z) has roots a, a, ...,@p, 
then there are 2? possible finite autoregressions, corresponding to the 2? possible repre- 
sentations of F(w): po 

F(w) = 





(12) 


| (z*1—«a,)(z*1—«a@,)... (z*1—a,) |?” 
Two of these schemes are unilateral, and differ only in that the ‘time’ axis runs in opposite 
directions. 

A similar argument applies for the least square fitting of a pth order autoregression to 
a set of data, since here again one works from the autocovariances, which could as easily 
have stemmed from one of the 2? fitted autoregressions as from another. 
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For the sake of example, let us examine once more the bilateral scheme (2). If the scheme 
has been normalized according to the last paragraph of §3 then the equation 


a—z+bz22=0 (13) 


will have one root inside the unit circle and one outside. Let us denote the roots «, #-1, 
[|a|<1,|#|<1). Defining coefficients A and B by the relation 


(z—a) (z—f) = 224+ Az+B, (14) 
we can construct an autoregression 
&,+ Ag, 1+ BE,» = & (15) 


which is unilateral and yet generates the same autocorrelations as (2). 
Evaluating integral (4) we find that a and 6 will be estimated by minimizing the quantity 


[1 +./(1—4ab)]-* X(é, —a£,_, —b&,_,)? 
w(1-+4/(1— 4ab)]-*[(1 +02 + 62) C,—2(a+)C,+2abC,], (16) 


where C, is the observed autocovariance of lags. Transforming to parameters A and B we 
find expression (16) proportional to 


(1+ A?+ B*)C,+2(A + AB) C, + 2BC,~ const. &(&,+ Aé,_, + BE,_.)*, (17) 


which is another indication of the equivalence of schemes (2) and (15). The practical signi- 
ficance of this equivalence is that the minimization of the rather awkward expression (16) 
may be replaced by that of the much simpler expression (17). The estimates of a and b may 
then be calculated from those of A and B by means of relation (14). 

It may seem unnecessary to introduce the bilateral type of scheme when any such scheme 
may effectively be reduced to a unilateral one. Indeed, the step appears positively un- 
desirable when we consider how much more complicated and indeterminate the parameter 
estimates are for a bilateral model. We shall see, however, that in the two-dimensional case 
the reduction to a unilateral scheme complicates matters very much, in contrast to the one- 
dimensional case we have just considered. There is thus no escaping the explicit introduction 
of a dependence in all directions. A further point is relevant: it is the multilateral scheme 
which in general corresponds to reality, even in those cases for which the formal work of 
estimation, etc., is simplest performed using an equivalent unilateral model. 


5. GENERALITIES ON THE TWO-DIMENSIONAL PROCESS 


One can consider continuous processes in which the variate has a value at every point of 
the plane, or discrete processes, which are usually such that the variate is observed only at 
the points of a rectangular plane lattice. We shall for the most part consider the discrete 
case, as being simpler mathematically and of greater practical interest. The observed and 
error variates will be denoted &,, and ¢,, respectively (s,¢ = ..., —2, —1, 0, 1, 2, ...). When 
discussing continuous processes this notation wi!! be modified to £(z. y) and e(z, y) (x and y 
assuming all real values). 

The particular model which we shall consider almost exclusively is the two-dimensional 
linear autoregression, which we shall write 


L{T,, Ti) Sst = Eg; (18) 
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where 7, and 7; are translation operators defined by 








T, Est = batt, TEs = bot+1 (19) 
and L(T,,T) = 0 Day TTF. (20) 
j k 
Corresponding to equations (7)-(10) we have 

a oe | 21 

ins Lf, T') = 7? jk €s49,t+k> ( ) 

F(w,, @) = “ 22 

vd) = Tea) Lem) (22) 
= x Xl); k) dz, (23) 


where b,, is the coefficient of zj zf in the Fourier expansion of [Z(z,, 22)]~1, (2, = e1, 2, = es), 
v is the variance of the e’s, (j,k) the covariance of £,, and &,,;;,,, and F(w,, w,) the corre- 
sponding spectral function, as defined by (23). 

As before, it is necessary and sufficient for the validity of (21) and (22) that L(z,,z,) be 
not zero for any z, and z, which simultaneously satisfy | z,| = 1, |z,| = 1 (at least when the 
autoregression (18) is finite). We shall assume that the operator Z has been so normalized 
that L(z,,2,) will not circle the origin in the complex plane as either z, or z, moves around 
the unit circle. (If Z does not circle the origin as z, traces out the unit circle and z, holds a 
particular value, neither will it do so for any other value of z,. For if it should do so there 
would be some intermediate value of z, for which L would move through the origin, against 
hypothesis. ) 


6. UNILATERAL REPRESENTATION OF THE TWO-DIMENSIONAL PROCESS 


We shall prove, by a type of argument which is now well known (due to Wiener; see, for 
example, Wiener, 1949, p. 78), that a unique process may be found which will generate a 
given set of autocorrelations and in which &,, is expressed as an autoregression upon £,, 
(w>t) and &,,, (v><s, w unrestricted). That is, in the lattice of Fig. 1 the value at the white 
dot may be expressed in terms of the values at the black dots. The given autocorrelogram 
may obviously not be completely arbitrary, but the necessary conditions are very mild. 
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The first condition is that the autocorrelations be such that they could have been generated 
by a purely non-deterministic process, which implies among other things that log F(,, w.) 
has a Fourier expansion, so that F(w,,w,) may be represented 





F(a, 2) = exp [x 2 jp 24 24]. (24) 

Define now the function i 
Pleyy%) = exp-[“8+ Daget+ SS anelal]. (25) 

k=1 j=1k=—0@ 
1 

Since F(@,,@.) = ‘ 26 
ved) = Pala) PGA) aid 
the autoregression P(T,, T;) Es: = €y (7?(e’) = 1) (27) 


will have spectral function F(w,,,), as required. Further, the expansion of P(T,, 7;) will 
involve the same powers of 7, and 7',as occur of z, and z, in expression (25), so that the 
autoregression is of the required form. To ensure that (27) may validly be written out as 
an autoregression we include a second condition: that P(e™1, es) possessa Fourier expansion. 

Representation (27) corresponds to the unilateral representation in the case of a transect. 
It is by no means as useful, however, and for such purposes as estimation one is in general 
better advised to work with the original model. For one thing, it is not true in two dimensions 
as it is in one, that the unilateral representation of a finite autoregression is also a finite 
autoregression. This is confirmed by the following simple example: the finite autoregression 


(1+ B*) Soe = BlEssse+ $5,041 + $s,1-1) + €st (28) 
has a unilateral representation which is infinite: 
bu = 2Bbaisr— Passa PPborasia + BO BE Plbernins + ee (29) 


Further, the real usefulness of the unilateral representation is that it suggests a simplifying 
change of parameters (although the same parameter transformation is usually suggested 
in the evaluation of integral (4) or its two-dimensional equivalent). For most two-dimen- 
sional models, however, the appropriate transformation, even if evident, is so complicated 
that nothing is gained by performing it. For example, to calculate the unilateral repre- 
sentation of the model 

Eu = (Sire t+ Sere So,t41 + $s,-1) + Ee (30) 


one must evaluate the coefficients in the Fourier expansion of log [1 — a(z,+271+2_+22%)], 
and these are not expressible in terms of anything simpler than elliptic integrals. 


7. SAMPLING THEORY 


In this section we shall consider the sampling theory of the discrete process, deriving general 
estimation equations, tests of fit, and formulae for the asymptotic variances and covariances 
of parameter estimates. The pattern of development is similar to that of previous articles 
on time-series analysis (Whittle, 1951-3), apart from the fact that special attention must be 
paid to the effect of multilaterality. The particular processes considered are those which are 
purely non-deterministic and for which [F'(w,,,)]~! is not zero for any real @,, @,, so that 
the process is representable as an autoregression. We shall also in general assume the 
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variates normally distributed. Estimation equations thus obtained on the maximum- 
likelihood criterion can be regarded as least-square estimation equations when the variate 
distribution is not normal, but the extent to which remaining results are valid in such a case 
is a matter for further inquiry. 

Let us suppose that we have a series of mn observations £, (s = 1,2, ...,m;¢ = 1,2,...,m), 
so that the empirical covariance of lagj, k is 


] m-in-k 
Cy = inal 2 but beti,t+k (31) 
We shall uniformly neglect end-effects, and so have divided in (31) by mn instead of 
(m—j)(n—k). Let us further define the quantity 


f(@4, 2) = — {(EEke Cos (sw, + tw2)]? + [LY Dsqsin (sw, + tw) ]*} 


=F SC, 008 (jw, + erg) 


—m~n 


mn 
=F LO, eierthoy), (32) 
—m~—n 
which we see on comparison with (23) to be the empirical spectral function, and in fact the 
appropriate extension of the Schuster periodogram to two dimensions. 

At the end of the section we shall prove the following basic result: that if the variates 
£4 are normally distributed with zero mean, and are generated by a stationary process of 
the type considered with spectral function F(w,,w,), then their joint likelihood is given, 
apart from end-effects, by the expression 


poe 1 mn Qn ae f 
p(s) = xv? | — aes, . F duydu] , (33) 
l Qn (2m 
where V = exp lal, [, log Fdo,do,| ‘ (34) 


Taking the logarithm of (33) we see that the maximum-likelihood estimates of the para- 
meters of F are obtained by minimizing 


Q= a | i) flog +5| deo, dea. (35) 


Even if the variates are not considered to be normally distributed, expression (35) will upon 
minimization yield the least-square estimates (see Whittle, 1953, p. 132). 

Expression (35) actually does not lead to the most convenient form of the estimation 
equations, this is obtained by expressing 2 in terms of the autocovariances rather than the 
periodogram 


1 
Q= im | flee Fdw,dw,+ DUC Cus (36) 
where the coefficients c are given by 


Eden = Foo: (37) 
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Consider now the special case of a process generated by a stochastic difference equation 
of type (18) so that 





F= : 38 
Lene) La a) = 
Inserting this relation in (36) we obtain 
2 = logv+logk+U/mnv, (39) 
where U= py py e% = ~ = [L(T,, T,) Fal" = ~ > Cin Cy (40) 
and logk = — re) =| fog [L(2,, 2.) L(zz?, 2y7)] dw, dig. (41) 


The minimized value of (39) with respect to the irrelevant parameter v is log (kU/mn), so 
that the quantity to be minimized with respect to the parameters of L is kU. This is the 
result which is of most use in investigations of the present type: that the least-square esti- 
mates are yielded by the minimization of the usual ‘residual sum of squares’ times a function 
of the parameters, k. We see from (41) that —}logk may be interpreted as the absolute 
term in the double Fourier expansion of L(e™:, es), a fact that may so.xetimes ease its 
evaluation. 

Suppose that F contains the unknown parameters 0,, 0,, ...,0, (v being included among 
these, if, as is usual, its value is unknown). Then, following a familar line of reasoning (see 
Whittle, 1953, p. 135, for an application similar to the present one) that the asymptotic 
covariance matrix of the least square estimates of 0,, 0, ....0, is 

2/71 dlog F dlog F a 
— Fe i) “36, ~ 06, dv, do,| ; (42) 

Suppose again that when the p parameters have been fitted the minimized value of kU 
is (kU),, and that when an additional g parameters have been fitted the quantity falls to 
(kU),4q- Then we can test the improvement attained by the introduction of the extra q 
parameters by using the fact that, if the initial p-parameter hypothesis were correct, then 


y? = (mn—p—q)log ED) (43) 





would be asymptotically distributed as. y? with q degrees of freedom. The argument is 
again an old one (cf. Whittle, 1952, 1953). 


Proof of relation (33). Let the process under consideration have the unilateral repre- 
sentation (27). The joint frequency function of the mn residuals ¢;,(s = 1, 2,...,m;t = 1,2, 
wy 1) is 


pica aL he fo BR 
Pl) = caayaomn =P | 5 EE (|. (44) 
Performing the linear transformation to which (27) is equivalent, we obtain (neglecting end 
effects) the following expression for the frequency function of the £,: 
ee mn r jmn . 


Am [ mn 
© (Gq) Kmn) O*P | — > g & Lie Cn 


~ Gayton =| } mis L dwdw,], (45) 








442 3 Stationary processes in the plane 
where A is the coefficient of &,, in (27). By (24) and (25) 


A = e—t%o0 = exp|— gal log Pde de] > (46) 


which on insertion in (45) leads to (33). 

The nature of the approximate equality in (45) may be specified more exactly. If the right- 
hand member in (45) is denoted p’, then the relation obtaining is that log p and log p’ are 
asymptotically equal (neglect of end-effects leading to neglect of terms in the exponent). 
This kind of approximation is quite satisfactory, since the addition of a term of relative 
order m-! or n-! to the logarithm of the likelihood will for large m and 7 have little effect 
on either the values of the maximum-likelihood estimates, or the significance points of 
likelihood ratios. 


8. NUMERICAL EXAMPLES 


Neither of the two sets of numerical data to be examined provides a picture book example 
of the particular models we have been studying, but they are perhaps the more valuable 
for just that reason. 

The first set of data concern a uniformity trial on wheat (yield of grain) conducted by Mercer 
& Hall (1911). It involves 500 plots, each 11 ft by 10-82 ft., arranged in a 20 x 25 rectangle, 
plot totals constituting the observations. The first and fourth quadrants of the correlation 
field are given in Table 1; the second and third quadrants can be filled in by means of the 


relation ¢(—j, —k) = $(j, k). 


We note that correlations along the north-south (s) axis are considerably stronger than those 
along the east-west (¢) axis, at least part of the explanation presumably being that the plots 
are not square. Correlations are generally higher in the north-east direction than in the 
north-west, indicating a definite directional effect. Another fact worthy of note is that 
correlations do not decrease monotonically as one moves out from the origin, instead they 
dip to a minimum and then rise again. One could imagine competition between neigh- 
bouring plants producing such an effect if the distances were smaller, but the more likely 
explanation in the present case is that there are ‘ waves of fertility ’ of the kind often remarked 
in a ploughed field (see, for example, Neyman, 1952, p. 75). 

In Table 2 we summarize the various schemes considered, giving the fitted coefficients 
and the corresponding values of k, U and kU. 

Since all kU are near to 0-7 we can say roughly that if the introduction of a new para- 
meter depresses kKU-by A, then by equation (43) A is significant at the 5% level if 


Tae] 
0-7 





3-841 < 500 log ( 


or A > 0-0054. The corresponding limits if two or three parameters have been introduced are 
0-0084 and 0-0110. These limits provide useful rules of thumb for judging significances of 
differences in kU in the table. Thus, hypotheses 1 and 3 do not differ significantly in degree 
of fit, while 1 and 4 very definitely do. Hypotheses such as 1 and 5 cannot strictly be com- 
pared in this manner, since neither hypothesis is a special instance of the other. However, 
one would be very much inclined to say that the fit of 1 is superior to that of 5, and this 
conclusion is borne out if one compares each in turn with the more general hypothesis 7. 
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The surprising feature of the results is that the simple unilateral scheme 1 fits the data 
so much better than the symmetric second order schemes 5 and 6. ‘Thus, although the theme 
of this article has largely been that spatial processes will in general be multilateral, our first 
example appears to be dominantly unilateral. The reason for this becomes apparent upon 
a re-examination of the correlations of Table 1. These correlations fall steeply as soon as 
a lag is introduced (to 0-52 on the s axis and 0-29 on the ¢ axis), but decrease only slowly as 
the lag is increased (the corresponding figures for a lag of two units are thus 0-41 and 0-15). 
However, it will be seen in § 9 that the correlogram of a scheme such as * or 6 decays smoothly 
right from the origin, having in fact zero derivative there (cf. Fig. 2), so that neither 5 nor 
6 can possibly fit the observations well. There are at least two possible explanations of this 
behaviour of the observed correlogram. The underlying scheme may in fact be a unilateral 


Table 1. Autocorrelations for the wheat data, s = 0 to 4,t =—3to +3 








t s=0 v4 é=3 s=3 s=4 
-3 0-1880 0-1602 0-1509 0-1276 0-1352 
—2 0-1510 0-0234 0-0020 —0-0137 -— 0-1039 
-1 0-2923 0-1853 0-1349 0-0788 0-0878 

0 1-0000 0-5252 0-4055 0:3639 0-3561 
1 0-2923 0-2354 0-1799 0-1205 0-1399 
2 0-1510 0-1285 0-0999 0-0749 0-0859 
3 0-1880 0-1935 0-2483 0-2415 0-2284 


























Table 2. Details of the models fitted 











Model 
ob L(T,, T;) k U kU 
1 1—0-4887', —0-2027', 1 0-6848 0-6848 
2 1—0-4837,,—0-179T;* 1 0-6940 0-6940 
$ 1—0-4927, —0-2117,,+-0-0197,,7;, 1 0-6845 0-6845 
4 1—0-4027,, — 0-1687', — 0-172T? — 0-0927? 1 0-6564 0-6564 
5 1-—0-159(7,4+77°+7,4T7;") 1-1240 0-6508 0-7314 
6 1—0-213(T, + T->) —0-102(7,+ 77) 11332 0-6217 0-7045 
7 1—0-4887', + 0-0307'* — 0-2027', — 0-03477 0-9843 0-6816 0-6709 




















one, due to e.g. the presence of a slope in the ground or a prevailing wind. Alternatively, we 
must recall that the observations are not point observations of growth, but integrated 
observations of the growth over an area. An integration such as this will enhance the auto- 
covariance of zero lag relative to the others, and the correlogram of a scheme such as 6, 
when thus distorted, would not be dissimilar to the observed correlogram. However, the 
consideration of such an effect would lead us too far for present purposes, and we shall take 
the observations at their face value. 

Scheme 1 is not completely satisfactory, in that it does not explain the dip and rise in the 
correlation for increasing distance. The inclusion of second-order terms in the same direc- 
tion as the first-order terms improves the fit considerably, see scheme 4. 
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Unilateral schemes such as 1-4 can be fitted directly by least square regression methods, 
since for them k= 1. The fitting of multilateral schemes such as 5—7 is more difficult, however. 
The evaluation of U according to (40) is direct, it is the evaluation of k from (41) which 
presents new problems. For the present calculations the pedestrian methods of series 
expansion and numerical integration have been employed, although it is likely that better 
methods exist. Thus, for a scheme 


bap = borat Pbsaet Vbo,41 + 8651-1 + Sots (47) 
we have log(k) = minus twice absolute term in log [1 — az, — fzy1 — yz,— zz") 


o fj ; 
= 22, sg Ep or OY i. 


For af = yé this reduces to 
oy] 2j 2 
] k => -< FS q, 49 
g(t) = 55 (7) (A) (49) 


=h 

Expansions (48) and (49) are useful as long as af and yé are very small, but convergence 
becomes slow as these quantities approach their maximum value of ;;. In Table 3 the value 
of log k in (49) is given for some specimen values of 0 = ./(af); these values have been ob- 
tained by numerical integration, and vary slowly enough to permit quite a fair graphical 
interpolation. 


Table 3. Specimen values of the correcting factor log (k) 


0 0-00 0-05 9-10 0-15 0-20 0-22 0-25 
log (k) 0-0000 0-0076 0-0420 0-1010 0-2028 0-2656 0-4406 


Table 4. Autocorrelations for the orange data, s = 0 to 9, t = —4 to 4. 





Values of s 








—4 
-3 
—2 
-1 5462 -4669 +4336 +3854 +3880 +3761 +3495 -2914 +2567 +2606 
0 
1 
2 
3 
4 









































The models of Table 2 were fitted simply by inserting trial values of the’parameters and 
calculating the corresponding kU. Improved values were then found by approximating 
kU in the neighbourhood of its minimum by a paraboloid, and then locating this approxi- 
mate minimum, whereupon the process was repeated. The work is tedious, but not un- 
reasonably so if one considers the effort which the data themselves represent. 
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We Our second example is derived from a uniformity trial of 1000 orange trees by Batchelor 

"| & Reed (1924), the trees being arranged in a 20 x 50 rectangular lattice. The correlation 

field p(s, t) is given in Table 4, and the correlations along the s axis plotted in Fig. 2. The 

(correlations in the two quadrants follow a very similar pattern, indicating a high degree of 

one symmetry in the original experimental field. A feature of interest is, that while the corre- 

lations p(s,t) for the most part change smoothly in value as one moves through adjacent 

values of s and ¢, there is a sharp discontinuity at the origin. The correlation surface thus 

(47) consists of a smoothly rounded broad dome with a spike at the apex. This suggests that the 
yield of an individual] tree, Y,,, may be represented 

















Yu = Sate (50) 
48 
where &,, 0 @ process with smooth correlogram, while ct 74 are uncorre wit: 
(48) here &,, obeys a p: ith h logra hile distinct 7,4 lated with 
one another (or with the £,) so that the 7 correlogram consists simply of a ‘spike’ at the 
} origin. A natural interpretation of (50) springs to mind: that £ represents the fertility of the 
(49) 
106- 
nce 
alue © Points of observed correlogram 
ob- 0-8 —— The function p(s) =0-554 [(0-13s) K; (0-13s)] 
ical =f 
06 — 
04 
© 
oi 0-2-— 
— 
| 1 N N l l 1 
od 0 1 2 3 4 5 6 7 9 
[31 Lag 
370 . 
152 Fig. 2 
506 
i soil around the tree, and presumably obeys some simple symmetric process such as (30), 
230 ‘ while 9 represents the intrinsic fruitfulness of the individual tree. Looking at the correlo- 
i. gram, one would say that soil variability and tree variability contribute roughly 56 and 
508 44% of the total variation respectively. However, one should not forget the possibility 
that the tree may ‘integrate’ the fertility of the surrounding soil as in the previous example. 
and It is a much more tedious matter to fit a compound scheme such as (50) plus (30) than to 
iting fit a simple autoregression such as (30). Supposing var (7) = A and var (e) = B we have 
roxi- j “ 
, un- = e 1 
. Moves) = A+ Tate ty te 7 
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The quantities required for estimation purposes are log V and the coefficients in the expan- 
sion of F-1 (see (36)). We find 


1 © 1/2j\ ,. 
log V = +773 | [log Fedo, do, = log(A+B)+ 35 (= ) ait 


+ 4(af)? [1 — 28] 

+ 36(af)*[—4+42 — 4A?) 

+ 400(a)® [3 — 68 + 16f? — 329} 

+ 4900(af)8[—}+ 88 — 408? + 6043 — 32/4] 

+ 63504(a2)° [2 — 108 + 808? — 224,83 + 256/44 — 192495] 


> soos (52) 
and 


F- = D3cy,2{ 2 


= pli + (28 -2)8+ (1-58 + 48%) S*+ (4p — 126% + 899) 8° 
+ (—f£+ 136? — 286? + 1664) S4+...], (53) 


A 
S = a(z,+27' +2427"). 


where f= A+B’ 
Since the scheme is not a pure autoregression, 1 is not a polynomial and the coefficients 
c,, do not terminate, so that in the present case we find that we should have to include 
correlations of up to about lag 10 in order to obtain a sufficient approximation to the sum 
Xrc,,.C;, of (36). However, correlations are only available up to t = 4, to continue would be 
a very arduous matter. 

In general, if the scheme is not purely an autoregressive one it will be possible to apply 
least square methods only if the observed correlogram decays quite quickly. In a case such 
as the present, one it becomes necessary to use more primitive methods of fitting: e.g. 
equation of observed and theoretical autocorrelation coefficients. 

On the other hand, a slow rate of decay has the advantage that the discrete model may be 
approximated by a continuous one, which is in most cases a simplification. Thus, if in 
scheme (30) « has a value approaching 0-25 (corresponding to a very slow decay of depend- 
ence) then it is shown in § 9 that the scheme may be approximated by a continuous one with 
autocovariance function p(r) = const. rK, (xr), (54) 


where r is the distance between the two points considered, K, a modified Bessel function, and 


«= /(5-4). (55) 


The thin line of the correlogram (Fig. 2) indicates the values of function (55) when the 
constants have been adjusted for coincidence at r, and 7,. It is found that x = 0-13, whence 
a = 02489. 

The agreement looks impressive, but must be discounted considerably, since almost any 
monotone decreasing function would fit the observed curve reasonably well if only the end- 
points were arrange to coincide. However, if one fits, for example, an exponential curve in 


the same fashion, agreement is not at all as good, the exponential curve sagging too much 
in the middle. 
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9. SPECIAL PROCESSES 


Strictly, one does not need to be acquainted with the properties of a model in order to fit 
it to a set of data (cf. the examples of the previous section). However, a knowledge of these 
properties does help one to arrive at a good model quickly, to say the least. In the present 
context ‘properties’ is usually synonymous with ‘correlogram’, since it is most often the 
correlogram one uses to characterize a given set of data. We shall now examine a few special 
models and their correlograms, but in a rather unsystematic fashion, since few results of an 


explicit nature are obtainable. 
The simplest model of interest is the degenerate autoregression 
St = Choir pt PEs 111 + Eas (56) 
with ‘solution’ &.= >> ( +4 BMGs tips (57) 
j=0k=0\ J i 


For the process to be stationary, £,, being taken as the dependent variate, one must have 
|a|+|]£|<1(see §5). The autocovariances are generated by 


(1 — az, — f2q)-! (1 — azz? — fez*), 


and yield correlations p(s,0)=A%, p(0,t)=B*, 
8 ey t A 
pls,t)=| 3 (Ft?) artpats & (FE ") arpeBe, (58) 
j=0 k=0 
where SS ee ee 
2a ° 2B , (59) 


A = {(l+a+)(1+a—)(1—«+£)(1-—a—£)}. 


Formula (58) holds for s, ¢> 0. 
The continuous analogue of scheme (56) would be the first-order stochastic differential 
equation, formally written 


(+05 +7) Eee.y) = oley) (60) 


Rotating the plane to new axes X = 0, Y = 0, inclined at an angle tan—'(f/«) to the old 
ones, we find the relation may be written 


(Vict +A% 547) KY) = (KY), (61) 


where £’(X, Y) = (2, y), e'(X, Y) = e(x, y). That is, scheme (60) may be regarded as a series 
of Markoff processes running side by side in the direction tan-!(f/a) and independent one 
of the other. This indicates the degenerate nature of the first-order scheme. 

The simplest second-order scheme (and thus the simplest non-degenerate scheme) is the 
symmetric autoregression 


Eo = Hore t+ Ser $s,41 + $s,e-a) + Eat (62) 
Written in the form [ai + A?+ (1 - ] Eu = Ey (63) 
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(where A is the central difference operator) the analogy with the continuous relation, a 
stochastic Laplave equation, becomes apparent: 


[G) + (5) -*| S(x,y) = (x,y). (64) 


The continuous relation is the easier to handle (as was also the case for relations (56), (60)) 
due to its essentially less artificial nature. Explicit results have been obtained for scheme 


(62) (Van der Pol & Bremmer, 1950; Stohr, 1950), but these are not simple. From the formula 
(Titchmarsh, 1948, p. 201) 





1 etXu,+Foy) dy, dw r\* K (xr) a 
ani | opeapeer ~ (ae) Tey © IOP Y. e 
we deduce that for scheme (64) 
Sie, 9) = | | ** (a+ X,y+ Y)Ko(xr)dXd¥ (66) 
and ¢(X, Y) = x K, (kr), (67) 


where K, is the modified Bessel function of the second kind, order v. Since limrK,(r) = 1 
the correlation coefficient corresponding to (67) is 


P(r) = KrK, (xr). (68) 


Scheme (64) is a special case of the general second-order stochastic difference equation. 
According to the usual classification into elliptic, parabolic, and hyperbolic forms, (64) 
would be regarded as a circular form with centre at the origin. An investigation of the 
remaining second-order schemes would be of great interest, both theoretically and prac- 
tically. 

The correlation function (68) is of interest in that it may be regarded as the ‘elementary’ 
correlation in two dimensions, similar to the exponential e~*!*! in one dimension. Both 
correlation curves are monotone decreasing, but (68) differs in that it is flat at the origin, 
and that its rate of decay is slower than exponential. 

Attempts have been made to represent two-dimensional correlograms as sums of ex- 
ponentials, largely because the exponential has proved itself the natural choice in one dimen- 
sion, and the observed curves display the same monotonic decay. However, it is apparent 
from the previous paragraphs that the exponential function has no divine right in two 
dimensions, while the example of the last section indicated that a K, function fitted the 
observations better than did an exponential. 

Two-dimensional processes can be constructed which have exponential correlation 
functions, but these are very artificial. For example, Matérn (1947) has shown that the 
correlation function exp —« ./(X?+ Y*) corresponds to a spectral function (w3 + w? —a?)-+. 
The simplest process with such a spectral function may be formally written 


I(g)'+ (5) -=] E(a,y) = ele,y) (69) 


and it is difficult to visualize a physical mechanism which would lead to such a relation. 
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The examination of the two sets of uniformity data was begun by Mr I. D. Dick of the New 
Zealand Department of Scientific and Industrial Research, who also in large degree stimu- 
lated the author to the present investigation. Thanks are also due to the supervisor of the 
punched card calculations, Mr E. W. Jones. 
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[Eprror1aL Nors. The preceding paper by Whittle (on p. 443) and the following paper by 
Patankar (on pp. 459-60) both use as an illustration of theory Mercer & Hall’s (1911) wheat- 
plot data. On a first inspection it might be thought that the serial correlations in (i) the 
column s = 0 and (ii) in the row ¢ = 0 of Whittle’s Table 1, p. 443, should correspond with 
Patankar’s correlations described as (i) ‘along the rows, results over the whole data, original’ 
(last column of Table 5-2, p. 460) and (ii) ‘along the columns, results over the whole data’ 
(last column of Table 5-1). Reference to the authors has, however, confirmed that the 
quantities computed are differently defined. Thus if 

«= 1,2,...,25 denotes columns running from west to east, 

j = 1,2,...,20 denotes rows running from north to south, 


the co-variance in Whittle’s expression for 1,9 is 


25 20—s 25 20—s 


25 20—s 
XD % 5% j1e- DX Mx DX DX %.54./{25(20—8)}, 
t=lj=1 it=1j=1 i=1j=1 


with similar expressions for the variances. The corresponding covariance used by Patankar 
is, however, 25 (20-8 20-8 20—s 
> 


Lj) D 2%, 5%i,j+8— DL %,5% LX %%,540/(20—8) 
t=1\ j=1 j=1 j=1 


with similar expressions for the variances. Thus Whittle bases his serial correlations on the 
total variation and covariation while Patankar’s correlations are based on within-column 
(or within-row) variation and covariation. As might be expected, Whittle’s correlations are 
larger than Patankar’s because of the variation between rows and columns. ] 
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THE GOODNESS OF FIT OF FREQUENCY DISTRIBUTIONS 
OBTAINED FROM STOCHASTIC PROCESSES 


By V. N. PATANKAR 
The Ahmedabad Textile Industry’s Research Association, India 


1. INTRODUCTION 


The classical y? test of goodness of fit introduced by K. Pearson (1900) is concerned with the 
agreement between the distribution of a set of sample values and a theoretical distribution. 
The data are usually divided into r mutually exclusive groups and the corresponding group 
frequencies will be denoted by 7,, m2, ..., n,. If the group frequencies expected from the 
parent distribution be m,, m2, ..., m,, Pearson’s measure of deviation is simply 


2 % (m,—m,)* 

am Py m, - a) 
Then the test is provided by the fact that as the sample size tends to infinity the sampling 
distribution of x* tends to that of the standard y? distribution with r — 1 degrees of freedom. 
The importance of this test is realized by noting that the x? criterion can be shown to be 
equivalent to the likelihood-ratio test in large samples. 

The fundamental assumption underlying the above test is the independent and unordered 
nature of the sample observations. It is true that in many cases encountered in practice 
this assumption is satisfied, and hence this test has been widely used. However, with the 
recent developments in the theory of stochastic processes, some interesting cases have 
been found where there is some dependence among the sample observations (which may not 
be wholly attributed to random fluctuations). 

The first attempt to consider the effect of dependence among stochastic process data on 
the x* test was made by Bartlett (1951). He has discussed the problem of testing the good- 
ness of fit of a theoretical model to a ‘finitely dependent’ probability chain, by which is 
meant a stochastic process defined for discrete values of both variable and parameter, 
whose probability dependence does not extend more than a finite number of intervals. 
Bartlett, while primarily concerned with a complete test of the stochastic process model, 
showed that under certain assumptions (which he has stated in his paper) the asymptotic 
distribution of the marginal frequencies n,; is normal, but (1) has no longer a standard x? 
distribution (see also Good, 1953). 

Taking account of the fact that the marginal frequencies n, (i = 1, ...,r — 1) have asymp- 
totically the multivariate normal distribution, with variance-covariance matrix V = (¢;,), 


say, P. S. Neall (1952)* has suggested the following likelihood-ratio criterion to test the 
goodness of fit; he takes 


Ny —™M, 
A = (n,—™M, ...,2,_1—™,_1) v-( : ) (2) 


Np_4 — M,_ 


* I am indebted to Prof. M. S. Bartlett for having informed me about the unpublished work of 
Mr P. 8. Neall. 
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to have a x? distribution with r—1 degrees of freedom. In the independence case V- is 
simply ( By 1 ) 


mM, M,, 

where 6,; is the Kronecker delta, and hence A reduces to the expression (1). In the case of 
dependence V-! does not reduce to the above form and V~ has to be calculated separat« ly 
for each distribution. There are two serious practical disadvantages in Neall’s test. One is, 
if we assume that V is known exactly for a certain distribution, to find the inverse of V may 
be a practically impossible task for a large number of classes. Moreover, even in the simple 
cases of the Poisson and normal Markoff processes, the calculations of o? = o,,; and o;; to 
the exact degree of approximation may be difficult. 

Bearing this in mind, we may turn back to the standard criterion (1) which is com- 
paratively easy to calculate and would still from its functional form indicate any depar- 
tures from the null hypothesis that the given sample has been drawn from a specified parent 
distribution. On the assumption of the normality of the frequencies n;, we can find the mean 
and variance of (1), and try to fit an approximate x? distribution by the method of moments. 
This is the object of the present paper. 


2. MODIFIED y*? TEST OF GOODNESS OF FIT 
If n;—m,; = x; (i = 1,...,r—1), then under certain assumptions (see Bartlett, 1951), the 
joint distribution of the z,’s tends to a multivariate normal distribution, i.e. the probability 
density 


P{x}> exp {—4x’V-1x}, 


1 
where x is the column vector (x, ...,%,_,) and (1) reduces to the form 
x? = x’Qx, 
: 6; , 1 
O being (w+): 
The characteristic function of x? is 


1 





1 
,2(t) = a tr > 
[T= BHVOR a ua, 

j=1 


where the 6,’s are the latent roots of the matrix VQ. Hence the sth cumulant of x? is 


r—1 
kK, = 2°-(s— 1)! 3 6. 


r—1 r-1 r-1 r—1 
- If VQ = (a,,), then 2 0; = 2 us xt = 2X F545 
= i= i,j= 


i=1 


and hence we obtain the expressions 


BoA) -ES=4 wy, | 
t=1 4G / (3) 


Tr 2 7 
Fim) wit f eee | 
(x?) 2mm, y 
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Then a better approximation to the standard x? is obtained by taking Ax?/B to have an 
asymptotic x? distribution with A?/B degrees of freedom. This we call the modified x? test 
of goodness of fit. 

In the case of independence, 

m? m,m; 


aes ets =— 
oj =m, = O35 = n > 





where n_ is the sample size. These results do not hold good for the dependence case. To 
obtain these expressions in the latter case, we employ a familiar device of putting 


iis 1 if at any time ¢, the system is in the ith group (i = 1,...,r; ¢ = 1,...,m), 
@+"" \0 otherwise. 


Then n,; = > Xj; and after some algebra, we get 
t=1 


n-1 
of = m,—mi+2 X (n—s) PR, 
s= 


(4) 
n-1 n—l 
Os = —Mym, + 2 (n—4) PG + & (n—2) Ph, 


where P%} is the absolute probability of obtaining the observations belonging to the ith and 
jth groups at times ¢ and t+8, respectively, for all ¢ (assuming stationarity). 


3. Porsson-MARKOFF PROCESS 


The Poisson-Markoff process* as defined below is playing quite an important role in the 
theory of stochastic processes, and in many interesting situations the observations are 
found to be governed by this process. One such example is given by Chandrasekhar (1943), 
who has fitted a Poisson distribution to a certain sequence of observations by Westgren 
in his classical experiment on colloidal particles, to confirm the theory developed by Smoluch- 
owsky. The various observations in the sequence are not independent, and hence the validity 
of the classical theory to test the goodness of fit may be doubted. It is possible to find the 
approximate values of the mean and variance of x? and test the goodness of fit by the 
theory developed above. 

From the formulae (333) and (364) in Chandrasekhar’s paper mentioned above, it is 
possible to give the expressions for p; (the probability of the observation being in the ith 
group) and P¥) as follows: 


p= ere (i= 0, 1, 2, ove) | 
Pe ona piti-(] — pi)*t+i-% pt io | (6) 
itl 2 (i—t)! (j—-20)! 4! (1,3 = 0,1, 2,...), 
where v is the mean value and p, the correlation coefficient between the two consecutive 
observations. 
Suppose now that it is required to test the hypothesis that a given sample of n values 
2, 2%q,...,Z, is drawn from some Poisson-Markoff distribution with a known value of the 





* This should not be confused with the simple process with random unit jumps at rate A, sometimes 
referred to as the ‘Poisson process’. 
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parameter v. Every x, is equal to some non-negative integer 1, and we arrange the z, 
according to their values into k + 1 groups, pooling the data for the largest value of i, where 
the observations are few. Suppose we obtain in this way 


nm, observations withz =i, where i=0,1,...,4—1, 
mn, observations with z>k. 
The corresponding expected frequencies in the various groups are 
Mm; = Np; (i = 0, 1,...,4-—1), 
= Np, = 0 Y Yi. 
idk 
The joint probabilities are 
P§ (i,j =0,1,...,4-1), 


8) 
Pe = & PH (i = 0,1,...,4—1), 


Substituting the values of the above expressions from (5) into (4) and expanding the 
functions under the summation by Taylor’s theorem in powers of p,, we get 












































of = m,— 7 —_— J, (a1 Fie natin 
ati me IR tat mt oh-+ O(npt) (i = 0,1,2,...,4-1), 
off = m,— E+ 2” nz A Sees ' fn Bid 22 Aol 
faz! Come, nate mi \ micah 
1; = = as yA Ap, 4 [A BeBysncthy gE Armes 























n—10,C;mm;  ,n—3A,A;m,;m,; ot 

I Se 4 EAI 68 + O(npt) (i,j = 0,1,...,k—-1), 
: mm, .n—-1A;A,m,m, n—-1B;B,m,m;,  ,n—2A;,Aj;,m;m,) 
Cyrene ere, eT ee ee be ie 

n—1C;C,m,m,  ,.n—-3A;A,m;m,)\ 5 4) Gea 

Ema QAR p+ Olnpt) (i = 0,1... 1), 
where A, =v-i, 


B, = v*—2vi +i(— 1), 
C,;, = B—- re ee 
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k-1 
We have > A,m,+ A;,m, = 9, 
i=0 


k-1 
> Bym,+ Bm, = 0, 
i=0 


k-1 
Cy, + Chem = 0, 
Sout 
and we write approximately, for large k, 
k-1 i) 
x Ajm,+Aym,~ Y Aim, = nv, 
i=0 i=0 


k-1 Ce) 
Zz Bim + Bim, ~z Bim, = 2nv*, 


k-1 oo 
EC}, + C2 mi, ~ EF Om, = 6nv*, 


k-1 © 
x A, Bym, + A, Bm, ~ ZABim = 0. 
i=0 = 

With these values, expressions (3) reduce, for large n, to 


E(x?) ~k + 2p, + 4p3 + 4p7 + O(p}), (6a) 
V(x?) ~ 2k + 8p, + 249? + 3203 + O( ps). (6) 


We can rely on these formulae only for small p,, when the fourth powers of p, are small 
compared with the third power. 

The higher degree terms in p, can be calculated, but they require laborious algebra. 

To illustrate these results, Chandrasekhar’s fitting of the Poisson-Markoff distribution 
may be considered. The 1583 observations are grouped into seven classes giving x? equal to 
8-9501. The mean value v is known to be 1-428 and the correlation coefficient calculated 
from the theoretical formula is 0-606. 

From (6) the mean is 9-571124 (the contribution due to the term in p? in this being 
0-890180); and the variance is 32-783104 (the contribution due to the term in p? in this 
being 7-:121440). As noted above, p, seems large enough to doubt the accuracy of the 
variance and hence the calculation of the higher degree terms seems essential. The higher 
degree terms for the Poisson process are not yet found due to the heavy algebra involved, 
but for the normal Markoff process (which is discussed in § 4 later), all the further terms are 
easily calculated (see (8)). Since the terms up to the third degree in (8) coincide with those 
in (6) we have taken (8) as an approximation to (6), and have used it for the Poisson-Markoff 
process as well. Then we have the mean approximately equal to 11-6298, while the variance 


is approximately 57-91344. The modified y? is equal to 3-5946 with 4-67 degrees of freedom, 
which is quite insignificant. 


4, NorMAL MARKOFF PROCESS 
Let there be a sample of n values, z,,%,,...,2, and the probability for such a sample be 
given by the normal Markoff distribution, viz. 


1 wae [(x,—m) — p,(x,_, —m) }* 
vey iq) = a es _ Wr , 
Ply) = Tome? r Th encase | 20%(1 —p?) 7) 











(7) 


es 
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The sample values are grouped into k classes, the ith class containing n,; observations 
situated in the interval (£;—4h,£;+4h), where £; = £,+(¢—1)h. The case of finite classes 
(cf. Bartlett, 1951) is artificially obtained by. taking the first and the last classes as 
(—00, &, + $h) and (&, — 4%, 00) in the same way as is done in the case of independent observa- 
tions. We want to test the hypothesis that the sample has been drawn from some normal 
Markoff population with the specified values of m and o. If this hypothesis is true the pro- 
bability p,; corresponding to the ith class is 


1 
= ———__ | e-(z—m)*/20? 
P= Tene) 


where the integral is extended over the ith class interval. Then np; = m, is the expected 
frequency in the ith class. Also P) as defined in (4) is given by 


1 1 
PO = aa T=R ly %? | aa pp Pee) m+ yma dey, 


Hence, from (4), 





-—8 1 
mT —m +275 Jeno Ja me 


Adie p{ - ur BoXI — pw le m)? — 2p3(x — m) (y—m) + (y—m)? s}aedy 


| e—az—m)}*/207 Ja 
t 





For small h, an approximate solution may be obtained simply by replacing the functions 
under the integrals by their values at the midpoint £; of the corresponding class interval, 
multiplied by the area of integration.* Then 


—s | h 


a 
— = 1-—m,+2 , eEi—m)"/20° 
m; ee" atm 1 —piy(20) 0’ 
1 
where o”2 ot tA Hence 
k of -In—gs 1 
hate 
An” en 8% 1-Gf 
‘ 
since , eEi—m)"/20"8 
La 


is equal to the sum of the ordinates of a normal curve (with s.p. 0’) multiplied by the length 
of the class interval, and becomes approximately equal to one. Hence 


In-8 pi 
E(x?)~k-—1+4+2 : 
(x?) ~ Pi a Top 





which for large n, can be written as 


n—-1 
E(x?)~k-1+2 
%) het 


* I wish to acknowledge my thanks to Dr B. L. Welch for this helpful suggestion. 





(8a) 
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Employing exactly a similar argument for ¢,,/,/(m,m,) and putting 


k 
SaaF TTA ey? | — sam py Em Bole —m) Em) + (E—mye} = 





™Iln—8s pi m1 n—-sn—t pit 
we get V(x?) ~ 2(k-1) +8 © ——-—1 +8 aE SSM, 
s OS oe HA ee ee Laie 
which again, for large n, becomes 








n—-1 n-1 +t 
V (x2) ~ 2(k— +8'5 e+ 8S ae ness (A an (85) 


To illustrate the above theory we consider the artificial series (nos. 7, 9, 11, 13 and 15) of 
M. G. Kendall (1949). There he takes the series generated by the equation 


U4 — PiU = S41, 


where €,,, is a random normal element (0, 1). Then u, has a normal Markoff distribution with 
mean zero and variance 1/(1—,?) and the correlation coefficient p,. A normal curve was 
fitted to each of the series with the same number of classes, viz. 10, in each case. 

Table 4-1 gives the modified x? test of goodness of fit for the above series. 


Table 4-1. Modified x* test of goodness of fit for M. G. Kendall’s series 








Se i 8 
cng Pr Observed x? E(x*)=A V(x?) =2B ry x v.F. A?/B 
15 0-1 6-579 9-244 19-080 6-3749 8-9572 
13 0-3 8-397 10-134 24-088 7-0654 8-5269 
11 0-5 21-746 12-214 39-952 13-2962 7-4681 
9 0-7 17-231 18-512 110-560 5-7703 6-1992 
7 0-9 26-833 63-172 1165-816 2-9080 6-8462 





























All the values are insignificant, and as far as one can rely on this test, there is no reason 
to doubt the fit. 


In general for any stationary normal process, we obtain 


E(x?) ~k 





V(x2)~2(k—-1) 48'S Pe 48" Po gy 
ex1l—P, = s, t=1 1— Ppp, 





5. TWO-DIMENSIONAL NORMAL MARKOFF PROCESS 
Let the N observations be denoted by z;; (i = 1, 2,...,m,; 7 = 1,2,...,m), where N = n,n, 
(with m, columns and n, rows) and z,,; are supposed to be drawn from a normal population 
with 
E(x;;) = my, V(x;43) = 0%, 


E (x4; — mj;) (Vise, 344— Miss, jae) = Pije™ ij Tits, j+t 


This will be a stationary process, if 


My=M, Gi, = 0%, Pija = Pu and py = P-s,-t = P-s,t = Ps,» 
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and we suppose that these conditions are satisfied. Then it is quite easy to note that the 
marginal distributions of x,; and (x;;,7;,, ;,,) are given by 


e-(xjj—my/20% 


1 
P(z;3) = J@n)o 
P(%i5s Xi4s, 544) = Ina Jl — pa) 
x exp ee [(x;3—m)* — 2p,,(x,;—m) (Tiss 544—™) + (Tire j4e—- ma : 


Let the sample of N values z,; be grouped into & classes, the ith class containing n; obser- 
vations situated in the interval (£;— 4h, £,+ 4h), where £; = £,+ (¢—1)h. We take the first 
and the last classes to be (—00,£,+4h) and (£,—4h,00) as usual. We want to test the 
hypothesis that the sample has been drawn from some normal stationary population with 
the specified values of m and a. If the hypothesis is true, the probability p,; corresponding 
to the ith class is It 
D; = JQ@mo Al e—z—m)}*/20* dz, 

where the integral is extended over the ith class interval. Then Np; = m, is the corres- 
sponding expected frequency. To obtain the variance and covariance of the marginal 
frequencies we employ the same device as in the case of one-dimensionai processes by putting 


(p = 1, ...,%,; ¢ = 1,...,%; § = 1,...,&), 


1 if at any time (p, 7) the observation belongs to the ith class 
Xp e= 
0 otherwise. 


Then ‘ < Xo. gi = %,; and after some algebra, 
p,q=1 


of = m,—m3+2 ‘= ng(m, —8) Pz +2"" = "y(q—1) PY42"S "S* (m—8) (ng—|t|) PY 
s=1 _— an 
t+ 


and 


oi; = —M,m;+ > *rig(m, — 8) PG + = *nig(mr, — 8) P+ 7% n(n —t) PY? 


+ °S) (ny) P+ "SS (mys) (mg—| |) PY 
t=1 s=1 ier} 


™m—1 ns 


“e = a ithe (m,—|t|) PH, 
s=1 “ae 
where P¥;° is the absolute probability of obtaining the observations belonging to the ith 
and jth classes at times (p,q) and (p+ 8, q+) respectively, for all p,q (assuming stationarity). 
We get, proceeding on the same lines as for the one-dimensional process, 


N— m-1l.m—-ly — os 
m—8 _ Po + 2 1,1 — _ Pot +4 b> ny SNe t Pst f 
T—-- — Ps t=1 Mo 1—py —Pou 8,t=1 NM, Ny 1—Ppy 


E(x2)~k-14+2 5 





which for large n, and 7,, 


™—1 ™m— ; ™m—1,m,—1 
pd 142% ee +2"5 Pu 44 Pat 


_*., 10a 
ra t=1 1=pe —Pu 8,t=1 1—py ( 
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and 





m-ly,—t 
V (x2) ~ 2(k— +8 = m Toba Am ep 
a -1m-ly —sn.—a’ 
ae} : Se ha De yy, Tote 
~In—-1y, —¢ t’ 
“ = A _ "* ee 
—1 n,—1 m—1 ,—1 —tn,—t’ 
lias =, a Pa 2 “a x 2 * 1 airy 




















™—1n,-1 po att 
M,—S8N_—t PoPo 

+163. 

Py Pa My Ne 1—PoPy 
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which again, for large n, and n, becomes 
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There are difficulties in defining a general Markoff process in two dimensions, but analogous 
to the one-dimensional linear process result p, = p|*', Quenouille (1949) has defined a process 
in two dimensions with different forms of the correlation function p,. We consider only the 
form py = pi’'.py', which he calls a degenerate Markoff process of the first order. With 


proper substitutions in (10), we get the mean and variance of x? for the normal Markoff 
process with p,, = p}*! pif!: 





2) k— oe. 
E(x?) ~k 1+22q- =y(1 98)’ (lla) 
2). (P5 +2) (1 + 4%) 
V(x?) ~ 2(k—- 1)+8> (1— pry — psy (116) 


To illustrate the above theory we fit a normal curve to the wheat-crop data for yield of 
grain given by Mercer & Hall (1911) and test the goodness of fit by the modified y? method 
(but not by the classical y* method, since it is natural to expect some correlation in the 
yields of plots adjacent to each other). There are 500 plots in a rectangular field arranged in 
20 rows and 25 columns. The data can be regarded as homogeneous as far as the variations 
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from north to south are concerned, but there is a trend in the data from west to east, which 
can be approximately represented by 


Y = 3-9485 — 0-019041(X — 13), 


where Y represents the expected mean yield in each column and X is an auxiliary variable 
taking values 1-25 corresponding to the columns from west to east. To make the data 
homogeneous, it is necessary to eliminate this trend. To keep the same mean for this modified 
data as that of the original data, we subtract the quantity — 0-019041(X — 13) from each 
of the observed values of the data. This we shall call the modified wheat-crop data. Next 
the serial correlations for the rows and columns of the modified data were calculated. These 
values are given in Tables 5-1 and 5-2. The last two columns in Table 5-2 give the serial 
correlations over the whole data, first column giving for the modified wheat crop data, and 
the second tor the original data (with this trend in it). For Table 5-1, the correlations are 


Table 5-1. Serial correlations along the columns 





























1 2 3 4 5 6 7 
T; 0-2747 0-6766 — 0-0677 0-0181 0-0202 0-3446 0-2495 
Ts; +1454 +2454 — +1201 — -1379 — +2612 -0953 +3408 
Ts; — -0050 — -0008 — +3252 -0105 +1542 — +1544 +2823 
, +1492 — -1619 +3058 — +2037 +3259 — 4245 *0555 
Ts; — 0415 — +2270 -1400 — -1772 -3726 — +3626 -0645 

8 9 10 ll 12 13 14 
w; 0-3875 0-4614 0-0157 0:3896 0-3318 0-0720 0:3697 
T. -1358 — -0587 -0087 -0153 — -0851 — +1647 -4342 
Ts — -0212 — ‘3811 -1325 — :3479 — -0906 — +3905 -1175 
%, — +2254 — +4968 — +1745 — +1259 +4133 — +1206 — +1358 
ts; — 1131 — -4001 — -0172 +1342 — -0759 -0665 — -3379 

15 16 17 18 19 20 21 
?, — 02252 0-7339 06321 0-4980 0-7223 0-1592 0-0173 
Ts — -3146 +5592 -4469 -4072 -4125 -2366 *1851 
ts -2079 -4748 +5124 *8315 -1694 — +2656 0154 
"%, — -0308 +4532 | *3605 +3370 — -0076 — -:1629 — +1446 
Ts; — -0193 -3096 | -0007 — -0459 -1146 — -1841 — -4016 

Result over 
22 23 24 25 the whole 
data 

T; 0-1452 0°2553 0:3225 —0-0381 0-3094 
1. +0575 +3401 -1022 — +3880 +1320 
ts — +1054 -5352 +3282 -1047 -0689 
% — -1034 -1018 — -0272 +3367 * +0559 
¥, — 0174 -2028 — +2616 — -0240 — -0360 
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Table 5-2. Serial correlations along the rows 






































1 2 3 4 5 6 
ry —0-0678 0-0530 0-1019 — 0-1860 —0-0458 0-1407 
T. — +1137 — +2164 — +1857 — 2199 — -4065 -0273 
tT; — +1337 — +2762 — +1595 +2116 — -1180 ‘0175 
% — -0149 — +1962 — -0053 — +2070 -1966 -1734 
Ts -1125 -0179 -0703 — ‘0528 — +3602 “1368 

7 8 9 10 1l 12 
vr; 0-2213 0-0092 — 0-2370 0-1229 0-5122 —0-1298 
1, — -0176 — -4525 — :3271 — -0223 +1265 — 2140 
rs +3199 0435 *3571 — -1087 — -0216 — -0866 
Ts — ‘0091 — -0892 -0594 — -1608 — +4286 — -0825 
Ts — -3077 — +1494 — +3239 — +2848 — +6254 -1958 

13 14 15 16 17 18 
wT, 0-2216 0-2350 0-1897 0-3144 0-3287 0-5012 
1; -0245 — +0754 -1852 +3682 +1497 +4579 
Ts — -0321 -0997 -3053 +2172 — -0725 -1215 
T, — +1850 +1292 -0130 -0672 — +1727 — -0312 
Ts — -1199 -0896 -2041 — -1216 — :4683 — +1399 

Result over the whole data 
19 20 
Modified Original 

rT; 0-6305 0-1853 0-1557 0-2544 
Ts *3417 -2093 — -0166 -0941 
Ts; — 0052 — +1206 -0372 -1282 
%, — +1247 -0575 — -0554 -0222 
Ts — +3147 — -3051 — +1559 — -0560 


























the same over the whole of the modified and the original data, and these are shown in the 
last column of the table. The correlations exhibited in the above two tables are very small, 
and hence the degenerate Markoff process of the first order, with the correlation function 
of the type p,, = p\°'p}!', seems to be quite a satisfactory fit to the modified data. We take 
Pp, = 0-1557 and p, = 0-3094 as the estimates of the population values. 

We fit a normal curve to the modified data. The various plots are grouped into eleven 
classes according to the weights of the grain, at intervals of 0-2 lb. The expected frequencies 
in the various groups are calculated by estimating the mean and the variance from the data. 
The x? is given to be 4-0787. The mean and variance of x? can be obtained from (11). There 
are k (= 11) classes, and on the assumption that the parameters are known a priori, we have 
obtained the constant factor k—1 in (11). However, in this particular example the two 
parameters m and o? were estimated to find the expected frequencies in the various classes. 
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Following the independent case one could approximately subtract 2 from the expected 
value of x? and 4 from the variance of x”. It is shown in § 6 that by estimating the parameters 
by the minimum x? method, not only the constant factor is affected but also the terms in p,. 
However, as this estimation problem is not discussed until §6, in this section we provi- 
sionally make a crude reduction in the constant factor only. Hence, taking k—3 for k—1 


in (11) we get E(x?) ~ 9-60, V(x?) ~ 28-04, 


and the modified x? is 2-79 with 6-57 degrees of freedom, which is insignificant, and hence 
on the basis of the above test we conclude that the normal curve fits the data. 


6. EsTIMATION OF PARAMETERS 


The effect of the estimation of the parameters on the modified y? test is still under investiga- 
tion, and it is hoped to publish the results in detail later on. Here we merely mention (without 
proof) some of the results so far obtained. 

The minimum x? estimates may not necessarily be the same as the maximum-likelihood 
estimates when the sequence of observations is dependent and ordered. 

However, the former are easy to find in practice and are obtained by maximizing 


M = ¥n,logm,. 
i 
We shall consider the effect of these estimates only on the average value of x”. If we write 


X? to be the value of x? when the minimum 4? estimates are substituted to find the expected 
frequencies, then for the case of one parameter 0 involved in m; 


E(@M/00) 


E(x!) — EX!) ~~ aoa 208)" 


(12) 


For the case of two parameters 6, and 0, we obtain 


_ Vay Mag + Van Mir — 2Vi2My2 


E(x’) — E(x’) sis MM, nt M2, ? (13) 
OM a eM 
where Vi; ca B55, 30; ’ M,; = ¥(=a6,) e 


For the Poisson-Markoff process the minimum x? estimate of the mean v is simply the 
sample mean (it turns out to be the maximum likelihood estimate also). The second member 
of (12) is approximately (1+ ,)/(1—,), and hence (6a) becomes 


EX) ~ k — 1 + 2p} + 2p? + O(p4). 


In the case of the normal Markoff process, the minimum y? estimates of the mean and 
variance are the sample mean and variance. The second member of (13) is simply 


1+p, 1+pi 
1-p, 1-p; 
for the one-dimensional process; and 
1+p,l+p,, 1+pil+p} 
1—p,1—p, 1—pj{1l—pj 
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for the two-dimensional process with py = p\°! p}!'. Hence (8a)and (11a) become respectively 


¥3\~, ae Pi 
E()~k-3+2 5 5, 


9 fg Pit ph 
MO wh 8+ 8S AA 
Thus not only the constant term is reduced but also the terms due to the correlation coeffi- 
cient, and hence we can apply the classical y? test with more confidence in this case (at 
least for small p,). 
For the Mercer & Hall data H(¥*) ~ 8-07 observed x? = 4-0787, and with the classical y* 
test the degrees of freedom for this are 8; and hence 4? is insignificant. 





7. SuMMARY 


The effect of the serial dependence of observations on the classical y? test is considered. 
For large correlations it is necessary to make the corrections to the mean and variance of 


x? given in this paper. The theory is illustrated with particular reference to the Poisson 
and normal Markoff processes. 


It is a pleasure to record my sincere thanks to Prof. M. 8. Bartlett, under whose super- 
vision this work was done. To him I owe the suggestion of the problem, and his comments 


and advice were invaluable during the investigation. I am indebted to Mrs Linnert for the 
calculations in Tables 5-1 and 5-2. 


REFERENCES 
Barrett, M. S. (1951). Proc. Camb. Phil. Soc. 47, 86. 
CHANDRASEKHAR, S. (1943). Rev. Mod. Phys. 15, 1. 
Goon, I. J. (1953). Proc. Camb. Phil. Soc. 49, 276. 
Kenpbat., M. G. (1949). Biometrika, 36, 267. 
Mercer, W.B. & Hatt, A. D. (1911). J. Agric. Sci. 4, 107. 
Neat, P. 8. (1952). A x* test for frequency data of simple Markoff chain processes (unpublished 
article). 

Prarson, K. (1900). Phil. Mag. 5th ser. 50, 157. 
QuENnoumL_E, M. H. (1949). Ann. Math. Statist. 20, 355. 

APPENDIX 
The following table gives the values of the expressions > p{/(1—pj) and > pi/(1—p%)? 

8 8 


involved in (8a) and (8b) for various values of p,. 


Table giving values of the expressions involved in (8a) and (86) ( correct up to three places) 








p: = pi/(1 —pi) 2 pi/(1— pi)? 
8 8 
0-1 0-122 0-135 
0-2 0-302 0-366 
0-3 0-567 0-761 
0-4 0-969 1-455 
0-5 1-607 2-744 
0-6 2-691 5-367 
0-7 4-756 11-570 
0-8 9-557 30-836 
0-9 27-086 143-477 
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THE DISTRIBUTION OF RANGE IN CERTAIN 
NON-NORMAL POPULATIONS 


By H. A. DAVID 
Commonwealth Scientific and Industrial Research Organization, Sydney, Australia 


1, INTRODUCTION 
The range has long been used as a measure of dispersion in samples from a normal popula- 
tion, and tables giving the moments and percentage points of its sampling distribution have 
appeared in many publications, particularly in those concerned with quality control. 
Comparatively little is known, however, about the distribution of range when the parent 
population is non-normal, although some useful information based largely on E. 8. Pearson’s 
empirical sampling investigations was reproduced in Tables XXIII and XXIV of Tables 
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for Statisticians and Biometricians, Part 2 (K. Pearson, 1931). In the present paper we shall 
derive some exact results regarding the expectation and probability integral of range in 
samples from a number of populations, mostly asymmetrical, whose £,, 8, points are shown 
in Fig. 1. Some of these results are obtained from explicit expressions for the probability 
integral P(w | n) and expectation &(w | n) of a range, w, in a sample of n. Others are derived 
from existing tables calculated for another purpose and based on quadrature. 


2. EXPRESSIONS FOR P(w|n) AND &(w|n) IN CERTAIN SPECIAL CASES 
It is easy to derive a formula for P(w |) which is valid for any continuous parental popula- 
tion with frequency function f(x). If, without loss of generality, f(x) is defined for 
—0oo <a<oo, the formula is (see, for example, Hartley, 1942) 


Pow|n) = nf” fcea([>"ferdy)” az 


= nf” fe) Pee+w)— Playas, (1 
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464 _ Distribution of range in certain non-normal populations 
where P(z) is the probability integral of f(x). &(w | n) may be obtained directly from P(w | n) 
or by the use of a formula given by Tippett (1925). 

We shall now consider a series of examples. 


(a) The distribution of x = —log 4x? for degrees of freedom v = 2 
This is the distribution 


f(x) =exp(—x-e*) (—w<2<o), (2) 


which was derived by Fisher & Tippett (1928) in their study of the limiting forms of the 
distributions of the largest or smallest members of a sample. We have 


P(x) = exp(—e-*) 


and P(x+w) = P(x), where v=e. 

1 
Hence P(w|n) = | Pn-l( Pe-1 — ])n-1 dP 

0 

=n > (-—1)4 (Vs :) [r+(n—r)e’]-. 
r=1 r—l 

The frequency function of w is therefore 

bs n—2 ; 

f(w|n) = n(n—-1) x —1)-1 :) e’ [r+(n—r)e]. 


Further, it may be shown that 


°  we“dw 
J o [r+(n—r)e”}? r(n—r) log (r/n), 





and hence E(w|n) = 3 wf (w | n) dw 
= z (-—1y (*) log (r/n). 


(6) The exponential distribution, or distribution of 4x? with degrees of freedom v = 2 
f(x) =e* (0<x<~@). (3) 
Here P(w|n) = (1—e-”)"-, 
n—-1 
&(w|n) = ¥(n)—W(1) = Ee, 
where y(n) = dlogI'(n)/dn. 
It is also easy to obtain P(w |) for the case 


f(x) =ae*+be- (0<x<00). (4) 




















(2) 
the 


(3) 


(4) 
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(c) The distribution of 4x? with degrees of freedom v = 4 


f(x) =xe* (0<2x<00), (5) 


P(w|n) =u i :) “ vt, 


r—li}/n 


where u=1l-—e’—we-’, w=1-—e, 








E(w|n) = > (-1)2 (") > s(s—1)...(s—r+1) = > n(n—1)...(n—7+1) 


honk 
s=1 r=0 er r=0 nti 


(2) The distribution whose probability integral is the simple logistic curve 
fix) =e*/(1+e*)?_ (—w<x<00). (6) 
For this symmetrical leptokurtic distribution, for which ~£, = 4-20, we find 


E(w | n) = 2[y/(n) — ¥(1)). 


(e) The rectangular distribution, with limits 0 and 1 
f(z) =1 (O<x<\}). (7) 
Here P(w|n) = nw" — (n—1)w", 
E(w|n) = (n—1)/(n+1). 


Similar results for the probability integral and expectation of the mth-order statistic 
Lm (m = 1, 2,...,n) have been given elsewhere (David, 1952a). 

A good indication of the effect of departure from normality in the parent distribution is 
obtained by determining the probability that the range exceeds the ‘normal theory’ 
significance points. Thus if k(n,«) is the 100a% significance point for the standardized 
range W = w/c, in samples of n from a normal population with standard deviation ¢@,, it 
is necessary to calculate for the distributions given above, Q(w|n) = 1—P(w|n), where 
w = k(n, a) ,,. The last three columns of Table 1 give such results for the parent populations 
of equations (2), (5) and (3) respectively, taking « = 0-05, 0-01 and n = 2(2) 12. The values 
of k(n,«) were obtained from Pearson & Hartley’s (1954) Table 22. In the case of the 
rectangular distribution of equation (7), it is impossible for the range to fall beyond the 
normal theory significance points for the cases chosen, except for n = 2, a = 0-05 when the 
probability is 0-04. 

If d,, denotes the expected value of the standardized range W = w/o, in samples of n 
from a normal population, it is common to use w/d,, as an estimate of 7, because &(w/d,,) = o, 
for normal samples. Table 2 gives value of &(w/(d,,o,,))for m = 2(2) 12 and for the populations 
of equations (7), (6), (2), (5) and (3) respectively, thus indicating the amount of bias involved 
in the current procedure of estimating a standard deviation from a range or mean range 
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using the corrective factor appropriate for normal distributions. Plackett (1947) has shown 
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that the expectation of the ratio w/(d,,7,) has a finite maximum given by 


This is given in the last column of the table, and is attained when the inverse to P(x) is of 


m{2[(2n — 2)! — ((m — 1)!)2]/(2n — 1) H+. 


the form x(P) = const. {P”-1—(1—P)"—“}. 


Table 1. Showing the probability that the standardized range in samples of n from various 
non-normal distributions falls beyond the normal theory 5 and 1% significance levels 


(a = 0-05 and 0-01) 





















































Distributions of log x? Distributions of x? 
v (for x?) 12 6 4 3 2 4 2 
A, 0-18 0-39 0-61 0-84 1-30 2-00 4-00 
- int 3-36 3-76 4-19 4-61 5-40 6-00 9-00 
Equation no. ... — — — -—- (2) (5) (3) 
a n 
0-05 2 0-051 0-052 0-053 0-054 0-056 0-059 0-063 
+ 054 -058 -060 -063 -067 -070 077 
6 056 -061 -065 ‘071 ‘075 -076 -086 
8 -058 064 ‘070 -076 ‘081 -080 -092 
10 ‘059 -067 ‘074 ‘081 -087 085 098 
12 ‘061 -069 ‘077 ‘086 -092 -088 104 
0-01 2 0-012 0-014 0-015 0-016 0-019 0-021 0-026 
4 ‘013 ‘017 -019 ‘021 -026 028 -036 
6 ‘014 ‘019 -022 -023 -030 ‘031 -042 
8 ‘014 -020 -025 025 034 -034 -047 
10 ‘015 ‘021 -027 -027 037 ‘037 -050 
12 -016 -022 -028 ‘028 -040 ‘039 -054 
Table 2. Expectation of w](d,,o,,), the ratio of the standardized 
range to its normal theory expected value 
Type of es . 
et Wa Rectangular Logistic exp f ): nt e-*) f(x)=xe-* | Exponential aaameet 
Equation 
no. (7) (6) (2) (5) (3) — 
n 
2 1-023 0-978 0-958 0-940 0-886 1-023 
4 1-019 0-982 0-961 0-942 0-891 1-012 
6 0-976 0-993 0-968 0-947 0-901 1-007 
. 0-946 1-004 0-975 0-951 0-911 1-026 
10 0-921 1-014 0-980 0-955 0-919 1-054 
12 0-900 1-022 0-986 0-959 0-927 1-086 
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3. EvaLuATION OF P(w|n) BY NUMERICAL INTEGRATION FOR DISTRIBUTIONS OF x=log x? 


In cases where no simple explicit expression for P(w|m) seems possible, direct numerical 
integration at w = k(n,a)o, could be attempted by means of equation (1). The procedure 
is in general likely to be tedious, but for one type of distribution calculations for tables 
recently computed provide a quick answer. The present writer (David, 19526) computed 
a table (for normal variation) of the upper 5 and 1% points of the ratio s?,,, /8%,in. of the 
largest to the smallest mean square in a set of k independent mean squares s? (¢ = 1,..., k), 
each based on v degrees of freedom. Clearly the logarithm of this ratio is the range in a sample 
of k independent values of x = log y*, where v is the degrees of freedom of x?. 

From the quadratures yielding the framework of the s?,,,/s?;, table of percentage 
points, it was possible to find Q(w|n) = 1—P(w|n) for w = k(n,«)o, as in the previous 
section, and these values are included in Table 1 for vy = 12,6, 4,3,2. For v = 2 an explicit 
solution is possible and has been discussed already. The beta-coefficients for the distribution 
of x = log x, given at the head of the columns, are taken from Bartlett & Kendall (1947) 
who have studied these distributions in some detail. 

It will be seen that s?,,.. /s?,i,. is a special case of what Gumbel & Herbach (1951) have 
termed the ‘extremal quotient’, i.e. the ratio of the largest to the smallest of a set of in- 
dependent variates. The authors confine themselves in their applications to the case n = 2. 
Clearly all the results of §2 regarding the probability integral of range have immediate 
counterparts for the extremal quotient. 


4. GENERAL COMMENT ON THE RESULTS 


The results given in Tables 1 and 2 give a broad picture of the way in which the distribution 
of range is affected by departure from normality, when the parent distribution is roughly 
of x? or Pearson Type III form. The exact values for &(w/(d,,o,))in Table 2 may beextended 
by reference to the empirical results based on random sampling experiments summarized 
by E. S. Pearson (1950). Remembering that the rectangular and exponential distributions, 
and even the distribution f(z) = xe-* with £, = 2, £, = 6 are exceptional forms, it will be 
seen that the expectation is remarkably insensitive to changes in the population /, and /, 
values. Thus the estimates of standard deviation obtained in industrial quality control by 
dividing a mean range based on m small samples of size n is unlikely to be seriously biased 
and therefore will provide satisfactory control limits for a mean. 

Table 1 shows, however, that the position will be rather less satisfactory when we are 
concerned with providing control limits for the range itself. This arises because the standard 
deviation of range, w, just as that of the root mean square estimator, s, is a function of the 
population f,, very roughly varying as /(f,—1). For the asymmetrical parent distributions 
dealt with in Table 1, use of the normal theory control limits will therefore tend to make the 
statistician look for trouble in the shape of excessive variability when in fact the fault is 
departure from normality. This may not be altogether a bad thing. The effect increases with 
increasing sample size and is relatively greater, the more extreme the significance level used. 


5. COMPARISON OF THE EFFECT OF NON-NORMALITY ON 
THE TAIL PROBABILITIES OF W AND 8 
So far we have confined ourselves to a consideration of the effect of non-normality on the 
distribution of w. It is of obvious interest *o compare this effect with that on the distri- 
bution of s. Such a comparison has been mac’ » by experimental sampling for three empirical 
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populations (Pearson & Haines, 1935). The authors found, for m = 5 and 10, that the 
number of samples out of 500 falling beyond upper and lower normal theory 5 and 0-5 % 
levels was not significantly different for w than for s. 

A theoretical comparison is difficult, primarily because of the complexity of the distribu- 
tion of s for non-normal universes. The approach tried was to use Gayen’s (1950) Table 4, 
which gives the corrective functions for determining the tail probabilities of the variance 
ratio at the upper 5% normal theory significance levels. The present case corresponds to 
the test for compatibility of two variances in independent samples, one of which is very 
large, drawn from a population with common £, and /,. Thus, in Gayen’s notation we use 
v with v, = 00, Az = Ag, Ay = Ay. Comparisons of tail probabilities of w and s at their upper 
5% normal theory values are set out below for three of the distributions of x = log x* 
given in Table 1. 


Table 3. Probability that s and w fall beyond normal theory 5% levels when the 
variable is distributed as log x? with v degrees of freedom 











y=12 v=6 v=4 
Sample 
size, n 
8 Ww 8 w 8 w 
2 0-051 0-051 0-053 0-052 0-055 0-053 
4 0-058 0-054 0-066 0-058 0-075 0-060 
6 0-060 0-056 0-072 0-061 0-084 0-065 





























The results are interesting but the imperfect agreement for n = 2 (when w and s are 
equivalent) is an indication that the Edgeworth’s series approximation employed by Gayen 


is here not very satisfactory. The discrepancy is greater still for the other distributions of 
Table 1. 


I am grateful to Prof. E. 8. Pearson, for suggesting a number of valuable ‘mprovements 
to the first draft of this paper. 
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THE MEAN AND COEFFICIENT OF VARIATION OF RANGE 
IN SMALL SAMPLES FROM NON-NORMAL POPULATIONS 


By D. R. COX 
Statistical Laboratory, University of Cambridge 


By examining special populations, a table is obtained for predicting approximately the mean and 
coefficient of variation of the range of random samples of n (n <5), drawn from a population of specified 
kurtosis, £,. The effect of non-normality on various statistical methods that use the range is then 
considered. 


1. INTRODUCTION 


Since Tippett (1925) tabulated the mean range of random samples from a normal population, 
the range has been extensively used for the rapid estimation of dispersion. Moreover, much 
work has been done recently on quick significance tests in which the root-mean-square 
estimate of dispersion in the t-test, analysis of variance, etc., is replaced by an estimate 
derived from the range. All these uses of the range rest on the assumption of normality, and 
so it is of interest to examine the distribution of range from non-normal populations. This 
was first done by E. 8. Pearson & Adyanthaya (1929), and their work, and later work by 
Shone (1949), has been summarized, discussed and extended by Pearson (1950). The con- 
clusion was that in small samples the ratio of mean range to population standard deviation 
is not much affected by the form of the population, but that the coefficient of variation of 
range depends fairly critically on the population. In large samples the distribution of range 
is, of course, determined by the tails of the population and so is very sensitive to non- 
normality. 

The main object of the present paper is to predict the mean and coefficient of variation 
of range in small random samples of n (n < 5) from a population of given skewness and kur- 
tosis and then to show how these results can be used to assess the effect of non-normality 
on the common applications of the range. Such a prediction can only be approximate 
because there is no functional relation between the distribution of range and population 
skewness and kurtosis. There are four ways of proceeding: 


(i) by evaluating numerically the single and double integrals for the mean and mean 
square of range for a representative selection of non-normal populations; 
(ii) by sampling experiments; 

(iii) by a derivation of upper and lower limits for the mean and coefficient of variation 
of range of populations with given properties. This was first done by Plackett (1947), who 
obtained an upper bound to the ratio of mean range to population standard deviation in 
samples of given size from an arbitrary population. An important extension of Plackett’s 
work (Hartley & David, 1954) appeared as the present paper was being completed; 

(iv) by finding a set of populations with widely varying /,, 8, for which the properties 
of range can be expressed exactly or approximately in terms of known quantities. 

While (iii) is the most satisfying approach from a mathematical point of view, method 
(iv) seems to lead more directly to a working answer td the problem and it will be followed 


here. 
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2. MIxED NORMAL POPULATIONS 


Consider a population formed by combining in proportions 1 — yp, p normal distributions of 
zero mean and unit standard deviation and of positive mean y and standard deviation 7. 
We call such a population an wnsymmetrical mixed population.* The drawing of an obser- 
vation from such a populstion can be thought of as a two-stage process, first the selection 
with probabilities 1—, p of a normal distribution and then the drawing of an observation 
from the appropriate normal distribution. We shall assume that yw, 7 are such that in 
samples of the size considered no observation from the second distribution falls below an 
observation from the first distribution, i.e. that the constituent normal distributions are 
effectively non-overlapping. It is then easy to write down the mean and mean square of 
the range of random samples of n from the mixed population. For let d,, e, be the mean 
and mean square of range in samples of r from the unit normal population (Pearson & 
Hartley, 1951) and m, = 4d,, n, the mean and mean square of the largest value of samples of 
r from the unit normal population (Karl Pearson, 1931, Table X XI). 

To illustrate the method, let n = 3; then Table 1 shows the various possibilities. Thus in 
the second line the probability that only one observation is taken from the upper distribu- 
tion is given by the binomial expression 3(1 —p)? p, and given the allocation of observations, 
the range is the difference of a single observation from the upper distribution and the smaller 
of two observations from the unit normal distribution. The expressions for the conditional 
mean and mean-square range follow immediately. The overall mean range is the sum of 
products of the third and fourth columns of Table 1, and the overall mean-square range is 
the sum of products of the third and fifth columns. 


Table 1. Samples of three from unsymmetrical mixed populations 











No. of No. of 
observations | observations P a Conditional Conditional mean 
. . robability 
in lower in upper mean range square range 
distribution distribution 
3 0 (1—p)3 d, es 
2 1 3(1—p)? p +m, pP + Qywm,+7T? +N 
1 2 3(1—p) p* b+m,T p? + 2ym,_t +7*mZ +1 
0 3 p® d,T e,7T* 




















Similar formulae can be obtained for other values of n; there is no point in writing down 
a general formula. More refined formulae making allowance for the overlap of the two 
distributions can be found. They will not be given here, although they have been used to 
check that overlap produces no appreciable error in the conclusions set out below. 

We can deal in the same way with symmetrical mixed populations, i.e. mixtures in pro- 
portion 1—2p, p, p of the unit normal distribution with normal distributions of means 
#, — and standard deviation 7. Again we take y, 7 so that the constituent distributions are 
effectively non-overlapping. The mean and mean square of range can be obtained by a 
method similar to that used in Table 1, the details being a little more complicated. 

For both types of mixed population, the mean, standard deviation, f, and f, can be 
worked out in a straightforward way. The mean and coefficient of variation of range have 


* The use of mixed normal populations is by no means new. 
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been found for samples of size n = 2,3,4,5 from the following mixed populations: uv = 3, 
7=0;4=4,7 =0,4; ~ = 5,7 = 0, }, 1, taken in combination with p = 0-01, 0-05, 0-1, 0-2, 
0-5. Each combination of p, 4, 7 gives two mixed populations, one symmetrical and one 
unsymmetrical. The value of 2, goes from | to 8-2 and the value of £, from 0 to 2-2. 

The main justification for the use of mixed normal populations is that they form a suffi- 
ciently flexible set of manageable populations. However, some types of non-normality 
occurring in practice can be represented by a single normal population contaminated by 
occasional ‘outliers’. If the outliers have a normal distribution, a mixed normal population 
results. 


3. SOME MATHEMATICAL RESULTS 


The numerical work outlined in § 2 will be the main basis for the proposed relation between 
the properties of range and the form of the population, but it is very desirable to supple- 
ment this work by results for populations differing as much as possible from the mixed 
normal form. 

In random samples of n from a population with frequency function p(x) and distribution 
function P(x), the probability density of range, f,(w), is given by 


fa(ve) = n(n—1){" p(x) pla-+w) (Pla + w)—Ple)y-*de. (1) 


Consider the exponential population with p(x) = e~* (x>0, p(x) =90, x< 0). Then (1) gives 
(Maguire, Pearson & Wynn, 1952) 


Frlw) = (n—1)(1—e~) "Fe, (2) 


and the moment-generating function of range, M,,(t), is 


M(t) = | "ee fale) dao 


= Tin) (t+ 1)/P(n +). (3) 
The cumulants of range are obtained by taking logs and expanding in powers of t, so that 
the mean and variance of range are”S; 1/r and 1 /r?, on using well-known properties 
rT f= 
(Jeffreys & Jeffreys, 1946) of the digamma and trigamma functions. The above exponential 
population has standard deviation o = 1 and f, = 4, £, = 9. 

Similar calculations can be done for populations with frequency functions 2’ e~*/r!, where 
ris a small integer, although the results get rapidly more cumbersome as 7, n increase. A few 
results for the population r = 1,0 = /2, £, = 2, £, = 6, are given in Table 2, together with 
corresponding results for the exponential population, and, for comparison, the standard 
values for a normal population.* 

Plackett (1947) showed that the ratio of mean range to the population standard deviation 
o can, for given n, be made arbitrarily small by choice of the population. It is of interest 
to examine in more detail the conditions under which this ratio is zero. Now if the dis- 
tribution function of the population is P(x), the distribution functions of the largest and 
smallest values in a random sample of n are respectively P"(x) and 1—(1—P(x))". Since 
the range is the difference between the largest and smallest values, it follows that the mean 


* [These two population distributions are also considered, among others, by H. A. David earlier 
in this issue of Biometrika (see pp. 463-8)—Eb.]. 
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range, E(w), is the difference between the corresponding mean values and so is given by 
the Stieltjes integral 


B,(u) = [~ ed{PXa) +(1—P(a))"— (4) 
This converges at —oo if and only if | a2dP(x) converges, and at +00 if and only if 


[sac — P(x)) converges, i.e. (4) converges if and only if | zdP(x) converges.* Therefore 


the mean range is finite if and only if the population mean is finite. 


Table 2. Properties of range of samples of n from populations (a) e~*, (b) xe-*, (c) normal 






































Population (a) Population (6) Population (c) 
n 
Mean C.v. of Mean c.v, of Mean c.v. of 
range/o range range/o range range/o range 
2 1 1 1-061 0-882 1-128 0-756 
3 1-5 0-746 1-591 0-640 1-693 0-525 
4 1-833 0-636 1-961 —_ 2-059 0-427 
5 2-083 0-573 2-252 — 2-326 0-372 
In this case lim a(1—P(x)) = lim xP(x) = 0, 
zo I> oO 


and we may integrate (4) by parts to give 
B,(w) = [° {1 Pe(z)—(1- Play) de. (5) 


This is the form used by Tippett in tabulating the mean range; the present proof is con- 
siderably shorter than the one current in the literature (Kendall, 1943). 

We have proved, therefore, that there are many populations, in particular those with 
finite mean and infinite variance, for which Z,,(w)/o is zero. Further, such a population 
should be considered as having infinite f,. For although £, is strictly not defined, the 
original population is for practical purposes equivalent to one truncated at +X, where X 
is very large, and such a truncated population has a very large #,. Hence for some sets of 
populations Z,,(w)/o tends to zero as £, tends to infinity, although this is not true in full 
generality. 

4. NUMERICAL RESULTS 


We shall discuss in detail the results for n = 5, since this enables earlier work summarized 
by Pearson (1950) to be used. Fig. 1 gives mean range/(d;o), where d, is Tippett’s divisor 
for samples of five, plotted against f,. As indicated in the legend, results for five types of 
population are included in the diagram: 
(i) theoretical; rectangular (f, = 1-8), normal (f, = 3), xe~* (8, = 6) and exponential 

(2, = 9); 

(ii) symmetrical mixed normal populations; 

(iii) unsymmetrical mixed normai populations; 


* Full convergence is required and not just the convergence of a principal value. 
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Fig. 1. Samples of five. Mean range/(d,;0). + theoretical. © symmetrical mixed normal populations. 
x unsymmetrical mixed normal populations. @ sampling experiments. [ Shone’s discrete 
populations. ----- theoretical upper bound. 
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Fig. 2. Samples of five. Coefficient of variation of range. For key, see legend to Fig. 1. 
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(iv) results for various Pearson type populations obtained by sampling experiments 
(Pearson, 1950). A 95% confidence interval for the true value is marked by a vertical line; 

(v) Shone’s (1949) numerical results for five populations each with seven equally spaced 
discrete values. 

Fig. 2 is the corresponding diagram for the coefficient of variation of range. 

The dotted line in Fig. 1 is Plackett’s upper bound over all possible populations of 
E;(w)/(d;o). As noted by Plackett some of the points obtained by experimental sampling lie 
very slightly above the theoretical maximum. 

The following conclusions may be drawn from Figs. 1 and 2: 


(i) There is no point in introducing /, into the formulae for predicting the properties 
of range. This is obvious in a general way from the diagrams and can be confirmed by 
drawing smooth curves through the points and plotting the residuals against | £, |. 

(ii) Although there are certain systematic differences between the five types, the general 
agreement is good. A smooth curve drawn in Fig. 1 gives a maximum error of 5%. 

Similar graphs have been drawn for the smaller values of n and smooth curves drawn. 
Table 3 is constructed from these smooth curves and predicts the mean and coefficient of 
variation of range for n <5, £,<9. 


Table 3. Approximate properties of the range in random samples 
of n from a population with kurtosis By 











Mean range/(d,,7)=B,(f.) Coefficient of variation of range =C,(f,) 
Bz n=2 3 4 5 n=2 3 + 5 
1-0 0-886 0-886 0-850 0-806 1-000 0-575 0-375 0-258 
1-2 *947 945 -923 “896 0-853 -482 +302 233 
1-4 *974 -969 -947 -924 *814 -467 +303 -242 
1-6 *985 -981 961 -942 -796 -464 -319 -260 
1-8 -992 -987 ‘971 *955 -786 -469 -340 -280 
2-0 -994 -990 -977 -964 ‘780 -479 -363 -300 
2-5 -994 -990 -985 -977 ‘780 -509 -412 344 
3-0 -988 -986 -985 -982 -790 -538 -450 -384 
3-5 980 980 980 982 805 563 482 -419 
4-0 ‘971 -972 -974 -980 +822 -587 -509 -447 
4:5 -962 -963 -967 -975 -840 -609 -532 -470 
5-0 -952 954 -960 -969 *858 -629 -552 -490 
6-0 -932 -938 -946 -956 -893 -665 ‘581 *521 
7-0 ‘918 *923 -931 -941 -929 -696 -602 -542 
8-0 -907 ‘910 *915 925 -964 -723 622 -560 
9-0 -900 ‘897 -900 -909 1-000 -748 -636 -573 






































The tabulated values of mean range/(d,,7) for £, = 3 are slightly below the value of 
unity for a normal population, and the tabulated values for coefficient of variation of range 
slightly above the exact values in normal theory. This is clearly justified from Figs. 1 
and 2 and happens because the mean range for a normal population is, in small samples, 
very near the theoretical maximum, and any dispersion in the ratio (mean range)/(d,,c) 
must tend to reduce its value. A case can be made for using in practice a range divisor lower 
than the usual d,,; this and other practical implications of Table 3 are discussed in § 6. 
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5. NOTES ON THE DISTRIBUTIONS OF RANGE AND OF THE RATIO OF RANGES 


In the above work attention has been concentrated on the mean and scatter of range. The 
whole distribution function could be investigated in a similar way, and the results would 
be of some interest in indicating the effect of non-normality on the conventional ‘control- 
chart’ technique of setting limits at, say, the 5% point of the distribution of range. This 
will not be discussed in detail here, but since simple results can be obtained for theexponential 
population, these will be given briefly. 

The distribution function of range in samples from the unit exponential population is, 
on integrating (2), (1—e-”)"—1. This is given in Table 4 for n = 4 and is compared with the 
corresponding function for the unit normal population (Pearson & Hartley, 1942). 


Table 4. Distribution function of range of samples of four 











| Population 
Range 
Unit exponential Unit normal 
0-5 0-0609 0-0152 
1-0 0-2525 0-1057 
1-5 0-4689 0-2685 
2-0 0-6465 0-5096 
2-5 0-7734 0-7710 
3-0 0-8579 0-8537 
3-5 0-9121 0-9361 
4-0 0-9461 0-9758 
4:5 0-9671 0-9920 
5-0 0-9800 0-9977 
5-5 0-9878 0-9994 
6-0 0-9925 0-9999 
6-5 0-9955 -- 
7-0 0-9973 ao 
Range/o: 5% point 4-078 3-633 
1% point 5-700 4-405 
Range/mean range: 5% point 2-224 1-765 
1% point 3-109 2-140 

















The main comparison of practical importance is the one at the foot of the table, since it 
shows the effect of an extreme form of non-normality on the range control chart. It is 
discussed more fully in § 6. 

A further distribution connected with the exponential population and that can be 
investigated easily is the distribution of the ratio of ranges from independent samples. 
If w,, w, are ranges of independent samples of x from the unit exponential population, 
their joint distribution is 

(n — 1)? (1 —e-“%1)"-2 (1 —e-¥2)"—-2 e-%1-": dw, dwg. 


If we define r = w,/w,, make the change of variables to r, w, and integrate out w,, we find 
for g(r), the frequency function of r, 


g(r) = (n—1)? | a (1—e-?2)n-2 (1 — e-w)n—2 w, e~Wx+D dvs. (6) 
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Now it is easy to show that 
‘ e-Ts(] — e-P’2)"—2 dr = Pres teres {1—(1—e-72)"-3} 
r (n ye 1) We : 


Hence we may determine the distribution function, Q(r), of r by integrating (6) under the 
integral sign, thus giving 


1-—Q(r) = (n—- » f° (1 —e-t2)"-2 {1 — (1 —e-7"'2)}"—1 e's dw, 
=(n—- nfo —(1~—u’)"-} (1—u)"-2 du, 
0 


on putting u = e~“:, This is a rational function of r and for small n takes a simple form; 
thus for 
n=2, 1-Q(r) =2/(r+1); 


n=3, 1—Q(r) = (7r+2)/(r+1) (r+ 2)(r+3). 


From the corresponding formula for n = 4, which is rather more complicated. the upper 
10, 5 and 1 % points for the ratio of two ranges of four are found to be 3-3, 4-7, 9-6. The 
corresponding values for a normal population are (Link, 1950) 2-4, 3-1, 5-6. There is a dis- 
cussion in § 6. 


6. APPLICATION 


We now consider the practical implications of the above results by discussing in turn four 
types of application of the range. The aim is to indicate the methods for investigating the 
effect of non-normality rather than to present comprehensive conclusions. 

(i) Point estimation of dispersion. Suppose that there are available a large number NV 
of samples of n observations from populations of constant shape, and that it is required to 
estimate the standard deviation, o, from the variation within samples. Consider the 
estimates based on (a) the mean square within samples and on (b) the mean range within 
samples, using the usual divisor d,,. 

The first estimate has bias O(N-"), which we ignore, and approximate standard error 





(7) 
The second has approximate bias (B,(£,)—1)o and approximate standard error 


oC,,(39) B,(h2)//N, 


where B,(f.), C,,(22) are the quantities given in Table 3. 
The first thing to look at is the relative magnitude of the bias and the standard error of 
the estimate based on the range; the bias is the larger if 


(1—B,(B,))? ° 


The critical value of W is given for a few special cases in Table 5. Thus, except for small £,, 
N has to be large before the bias is comparable with the standard error. It is fair to say that 
in most applications the standard error will be the larger. 
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Table 5. Approximate value of N at which bias equals standard error 








+ Bs 1-0 2-0 3-0 4-0 5-0 7-0 9-0 
Z 60 16000 4200 760 290 110 81 
5 1 6400 440 480 230 15 33 
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Suppose now that N is such that this is the case and consider the ratio of the standard 
error of the estimate based on the range to that of the first estimate. This ratio is 


b.-3 


n 


20;,(B2) Bn(A2) 





2 )\-+ 
tay fo" (9) 
It is given for a few values of n and f, in Table 6. 


Table 6. Ratio of standard errors of estimate from range and root-mean-square estimate 








a4 As 1-0 2-0 3-0 4-0 5-0 7-0 9-0 
2 1:77 1-27 1:10 1-01 0-94 0-85 0-80 
5 1-32 1-06 1-07 1-05 1-00 0-90 0-80 
































The general conclusion is that for the small and moderate values of £, the root-mean- 
square estimate is the better one, but that for the larger values of £, the estimate based on 
the range, even though biased, is to be preferred. The reason is essentially that for popula- 
tions with large 2, very extreme observations are common, and these have relatively less 
effect on the range than on the other estimate. The conclusion only holds when N is suffi- 
ciently swrall for the bias to be neglected (Table 5), although if the population £, were known 
approximately, much of the bias could be removed by using a divisor B,(f,) d, instead of d,. 

This leads to the point noted in § 4 that the curves fitted to the mean range pass at £, = 3 
below the theoretical point for the normal population. In fact if little were known about the 
population except that £, lay within rather wide limits, it would be sensible to use a divisor 
2-5 % lower than d,,, depending on ” and the range of possible values of £,. For this would 
not lead to appreciable bias if the population were normal and would reduce the bias for 
extreme values of £,, both large and small. 

If 8, were known one could, instead of producing an unbiased estimate, choose a divisor 
as a function of n, N and £, in order to minimize, say H(s,,—)*/o*, where s,, is the estimate 
of o. This would be relevant if some irrevocable decision rested on the value of the estimate 
and if the ‘loss function’ were known, but in more usual cases I do not think anything would 
be gained by this. The criterion of unbiasedness, while certainly arbitrary, leads to an 
estimate with known distributional properties and centred near the true parameteric value; 
the point estimate is therefore near the true value, and the confidence distribution of the 
unknown parameter can be found and this is all that is required. 

(ii) Control chart for ranges. In the usual control-chart technique for ranges, the mean 
range is found for a preliminary run, and say 5 and 1 % limits set at multiples of the mean 
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range determined from the distribution function of the range in samples from the unit 
normal population. If the population is not normal two problems arise: 


(a) If the population f, is approximately known, where should the limits be placed? 
To answer this, we approximate to the distribution of range either by a y distribution 
(Patnaik, 1950), or by a x? distribution (Cox, 1949). These approximations have, of course, 
only been tested for the range in normal samples, but are here, nevertheless, employed as 
approximations to range in non-normal samples. Although we have checked this approxi- 
mation in the case of the exponential below this method must, as yet, be regarded as 
tentative. An advantage of the x? approximation over that using x is that it is rather simpler 
and deals more easily with mean ranges. Limits based on the x? approximation will be given 
here; the corresponding limits for the y approximation can be obtained similarly. Write 
range/(mean range) in the form x?/v; this assures agreement of the first moment, while to 
get agreement of the second moment we must take v = v,(f,) = 2/C2(,). Thus limits for 
range/(mean range) should be set at 1/v,(f) times the appropriate percentage point of x? 
with v,(f,) degrees of freedom. 

Example. For the exponential population C,(f,) = 0-636 (Tables 2 and 3),s0 that v = 4-94 
and the approximate 5 and 1 % limits are at 1/4-94 x 10-98, 14-98, ie. at 2-22 and 3-03, 
interpolating v-wise in the x? table. These compare with exact values of 2-22 and 3-11 
(Table 4). 

If a control chart is set up for the mean of m ranges of n the degrees of freedom become 
mv,(fz). 

(6) If there is no information on which to base a correction for non-normality, what 
errors is non-normality likely to introduce? If £, is small, the upper limits are set too high 
and it will be difficult to detect lack of control; conversely, if it is found that few or no points 
fall above the limits, this suggests that the population #, may be low. If £, is large, too many 
ranges will fall above the limits; thus for the exponential population it was shown in §5 
that more than 5 % of ranges of four lie above the normal 1 % point. This is, however, rather 
an extreme case of non-normality. Conversely, if an excessive number of ranges fall above 
the control lines, it is possible that the ranges arise from sampling a stable but non-normal 
population and that the process is ‘in control’. Indeed, it might require a lengthy analysis 
to decide by purely statistical means whether or not such a set of ranges are consistent 
with a state of control. 

(iii) Comparison of several variances. In the first two applications, only one unknown 
population standard deviation is involved. Now consider the problem of testing the 
hypothesis that two populations have the same variance, given the mean ranges of random 
samples from the two populations. If we continue to use the y* approximation to the 
distribution of range, we refer the range ratio 

R= Uibns 
Wen, 
to the F tables with (m,v,,m,v.) degrees of freedom. Here @, is the mean of m, ranges of 
n; from the ith population and v; are the effective degrees of freedom for a range of n,; from 
a normal population (Cox, 1949). 

Suppose now that the populations are not normal. Provided that the populations have 
approximately the same /,, the bias factors B,,(,) affect, for n; < 5, numerator and denom- 
inator almost equally, even if n,+n,. If the population /,’s were very different this would 
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not be true, but a test of the equality of the variances of populations of very different shapes 
is probably not a common problem, and this case will not be considered further. Therefore 
the only effect of non-normality is that the effective degrees of freedom should be 
(m, Vn, (Be), Me Vn(P2)), where v,(2) = 2/C?(B2)- 
Table 7 gives some conclusions, based on §5, for the case n, = n, = 4, m, = m, = 1, 
i.e. for the ratio of the ranges of single samples of four, where the population is (a) normal, 


Table 7. Percentage points of range ratio test for single samples of four 











10% 5% 1% 

Normal population Exact 2-4 3-1 5-6 
x? approximation 2-2 2-8 4-5 

xX approximation 2-4 3-1 5-7 

Exponential population* Exact 3-3 4-7 9-6 
x? approximation 3-5 5-1 11-0 























* The xy approximation is difficult to compute in this case. 


(6) exponential. The conclusions are first that while the x approximation is very good indeed 
for the normal population, the x* approximation is adequate in all cases, particularly when 
it is remembered that in nearly all applications the means of several ranges will be used, 
and not single ranges, and that the approximate percentage points will then be closer to 
the exact ones. Secondly, as would be expected, the use of the normal percentage points 
would be considerably in error with a population as non-normal as the exponential; the 
error would be much greater if the means of several ranges were used. 

Box (1953) has shown the serious effect of non-normality on the conventional tests for 
comparing variances. His results are not, however, directly comparable with the present 
ones, because his are concerned with the comparison of single large samples. The best way 
of comparing the relative stability of tests based on the range and on the standard deviation, 
for numbers of small samples, is to compare: 

(a) C,(f,)/C,,(3), which shows how the coefficient of variation of an estimate based on the 
mean of ranges of n, changes relative to its value for £, = 3; 


(b) the quantity (eon) * 1) > (10) 


which by (7) is the corresponding quantity for the estimate of standard deviation based 
on a large number of mean squares of samples of n. This is done in Table 8. The conclusion 
is that comparative tests based on ranges of small samples are appreciably less affected by 
non-normality than the corresponding tests based on mean squares. 

(iv) Use of the range in the t-test. In the preceding applications, the population standard 
deviation o is of direct interest; we now consider a case in which @ is a nuisance parameter. 
Suppose that 7 is the mean of r observations from a population of mean yw and standard 
deviation o and that o is estimated from @,, ,, the mean of m ranges of samples of n. To 
test the hypothesis that ~ = 0, the natural analogue of the ¢ criterion is 

=. (11) 
Wm, n 
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Table 8. Relative variation with B, of coefficient of variation of 
estimates of o from (a) range, (b) root-mean-square 


















































- Bs 1-0 2-0 3-0 4-0 5-0 7-0 9-0 
2 (a) 1-27 0-99 1-00 1-04 1-09 1-18 1-27 
(b) 0-71 0-87 1-00 1-12 1-22 1-41 1-58 
3 (a) 1-07 0-89 1-00 1-09 1-17 1-29 1-39 
(b) 0-58 0-82 1-00 1-15 1-29 1-53 1-73 
4 (a) 0-83 0-81 1-00 1-13 1-23 1-34 1-41 
(b) 0-50 0-79 1-00 1-17 1-32 1-58 1-80 
5 (a) 0-67 0-78 1-00 1-16 1-28 1-41 1-49 
(b) 0-45 0-77 1-00 1-18 1-34 1-61 1-84 
Table 9. Percentage points of Td, ./r/Wy, n 
Size No. 10% point 5% point 1% point 
of of 
sample | samples * . i 
x x x x x x 
4 a Exes approx. | approx. Baers approx. | approx. Teunes approx. | approx. 
5 1 2-02 2-02 2-04 2-63 2-64 2-68 4-38 4-39 4-51 
3 1-75 1-75 1-75 2-15 2-15 2-15 3-02 3-03 3-03 
8 1 1-85 1-85 1-86 2-32 2-33 2-35 3°45 3-50 3-56 
3 1-71 1-71 1-71 2-07 2-07 2-08 2-83 2-83 2-85 









































The exact percentage points of u for a normal population have been found by numerical 
integration by Lord (1947), and approximations based on the y approximation to the range 
distribution have been given by Patnaik (1950). The percentage points based on the x? 
approximation to the range distribution are obtained by referring 

r Zd,, Jr 


Gn, nll —1]0) 9) 


to the ¢t table with v’ = }v = }mp, degrees of freedom. The divisor (1 —1/v) simulates the 
bias of the estimate of standard deviation in the t-test, and the effective degrees of freedom, 
mv,, of the mean of m ranges of n, are divided by four to represent the transition from a x* 
variate, to the x variate occurring in the denominator of t. Table 9 compares the exact 
percentage points of 7d, /r/@,, , with those obtained by the two methods of approximation. 
The x? approximation is less accurate than the x approximation, although both are very 
good; the advantage of the x? approximation is that its use requires only a table of v, 


whereas the x approximation requires a double table of scale factors and degrees of freedom 
as functions of m, n. 
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If the population is not normal it is natural to replace (12) by testing 


zd, B, (Be) Jr 
Dm, n(1 7 Vn *(e)) 4 


as t with }mv,(f,) degrees of freedom. A more precise treatment would allow for the effect 
of correlation between the mean and the mean range; the general effect of this will be to 
increase the dispersion of (13) when /, is small and to decrease the dispersion when /, is 
high. Except in very small samples a change in the degrees of freedom is not important, 
and the only effect of non-normality is the insertion of the factor B,,(£,); this will not be 
important except in extreme cases and so as a general rule this test is not appreciably 
affected by non-normality. 

The broad conclusions of § 6 are that if 8, is known, it is possible to make a rough correction 
for non-normality in methods that use ranges of small samples, and that on the whole these 
methods are less affected by non-normality than corresponding methods using variances of 
small samples. 





(13) 


I am grateful to Mr D. A. East and Miss Patricia Johnson for their care with the numerical 
work. 
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THE DISTRIBUTION OF THE RATIO, IN A SINGLE NORMAL 
SAMPLE, OF RANGE TO STANDARD DEVIATION 


By H. A. DAVID, H. O. HARTLEY anv E. 8. PEARSON 


Commonwealth Scientific and Industrial Research Organization, Sydney, Australia 
and University College, London 


1. INTRODUCTION 


A number of recent papers have discussed the use in statistical analysis of the ‘Studentized’ 
range, that is to say, the ratio of (a) the range in a sample of n observations from a population 
having standard deviation o to (b) an independent root-mean-square estimate of o based on 
v degrees of freedom. Tables of the upper 5 and 1 % points of this ratio, in the case of normal 
variation, have been given by Pearson & Hartley (1954, Table 29). In the following paper 
we are concerned with a different statistic, namely, the ratio of the range, w, to the standard 
deviation, s, both measures of variation being calculated on the same sample of n obser- 
vations. While the first ratio can play a useful part in providing certain rapid tests in the 
analysis of variance, the second, whose value depends only on the configuration of a par- 
ticular sample, may be useful (with suitable tables) in detecting heterogeneity of data or 
departure from normality. 

Our interest in this matter arose as a result of correspondence between one of us and 
Dr Joseph Berkson who has for some time carried out a routine scrutiny of data by making 
a comparison of the range and standard deviation estimators of 7; in this connexion he 
initiated an empirical investigation into the correlation between the estimators in order to 
determine the standard error of the difference between them. Some years earlier, however, 
G. A. Baker (1946) suggested the use of the ratio w/s as a means of detecting lack of 
homogeneity, and showed by an artificial sampling experiment that the distribution 
of this ratio might be expected to change considerably with the form of the parent 
population. 

The object of the present paper is to provide tables of certain upper and lower percentage 
points of uw = w/s forsamples of n observations from a single normal population. Two methods 
of attack will be used: 

(a) We shall show that the exact moments of the distribution of u can be derived quite 
simply from the known moments of s and w. Hence approximations to the percentage points 
may be obtained from representing the distribution by any suitable frequency curve having 
the same moments, e.g. by a curve of the Pearson system. 

(6) Using a method employed by Pearson & Chandra Sekar (1936), we shall show how in 
small samples values of the upper percentage points of u may be calculated exactly. 

In an overlapping region of the table, these two methods provide some confirmation of 
the accuracy of the results. 

Finally, we shall give some numerical illustrations of how the ratio might be used to 
provide a quick assessment of the homogeneity or normality of data. 
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2. METHOD USING THE MOMENTS OF THE DISTRIBUTION OF u=w/s 


Let 2}, %q, ...,%, represent a sample of n independent observations from a normal population 
having variance o?. Write 


Z= Lan, s= ¥(e,-Z[(n—1), w= epg — Fa. 
i=1 i=1 


It may be shown, following an argument similar to that used by Geary (1933, p. 185; 1936, 
p. 296) and since employed by Kamat (1953, p. 124), that the joint distribution of the ratios 
(~,—%)/s(¢ = 1, 2,...,m) is independent of s. Hence any function of these ratios and in 
particular the difference of (x,,,,.—Z)/s and (Xin, —%)/8, or w/s, will be independent of s. 


From this it follows that E(u’) = &(w]s)’ = &(w")/E(s"). (1) 


On this basis the moments of u = w/s may be computed, making use of the moments of w 
as far as they have been determined, and the fully known moments of s. We shall be 
concerned here only with the moments of w up to the fourth; for n < 20 these have been given 
by Hartley & Pearson (1951) while for n> 20 values of the standard deviation and the 
fi, Bz coefficients were computed by Tippett (1925) (with some later modification by 
Pearson (1926)) at n = 20, 60, 100, 200, 500 and 1000. &(w) was, of course, given by Tippett 
for all sample sizes up to 1000. 

The procedure was then as follows: 

(a) Taking as framework the sample sizes n = 10, 15, 20, 60, 100, 200, 500, 1000, values 
of &(w*) for r = 2, 3, 4 were found from the moments about the mean. 

(b) The corresponding expectations of s* were obtained from 


E(8") = 07(2/(n— 1) )# TEA (n—1+r)}/TER(n— 1}, (2) 


and hence &(u”) was determined from (1). 

(c) The 2nd, 3rd and 4th moments of u about zero were then transferred to the mean, 
% = &(u) = &(w)/F(s), and finally values of o,,, £,(u) and £,(u) obtained. With the values 
for the moments of w at present available for large n, o,, could only be calculated to three 
and the beta coefficients to two significant figures. 

(d) Pearson curves with the same first four moments were then used to approximate to 
upper and lower 100« % points for a = 0:10, 0-05, 0-025, 0-01 and 0-005 and for the frame- 
work values of n quoted in (a) above. 

It was found that if these percentage points were expressed as standardized deviates, 
U, = (u,—%)/o,,, then the resulting values of U, were sufficiently smooth for interpolation 
in the panels of the frame for-n. Using these interpolated values and the formula 


u, =u+U,o,, 


where 7% is known to four and ¢,, to three decimal places,* the panels were filled in to give 
additional percentage points for u at m = 12, 30, 40, 50, 80 and 150. 

For n< 20 the percentage points should be accurate to within + 0-02 and a comparison 
with the exact percentage points (see § 3, Table 1), where these are available, does not reveal 
discrepancies beyond 0-01. For n> 20 the uncertainty in the beta coefficients of w alone 
may result in an uncertainty of + 0-02 in the percentage points. 


* Apart from Tippett’s (1925) values of o,, required for Cw additional values at n = 30, 45 and 75 
have been given by Pearson (1932, p. 405). 
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3. DERIVATION OF THE EXACT VALUES OF THE UPPER 
PERCENTAGE POINTS IN SMALL SAMPLES 


We have here followed a method previously used by Pearson & Chandra Sekar (1936) when 
determining upper percentage points of the distribution of (z,,,,, —%)/s in sampling from a 
normal population. This method proceeds as follows. 

Suppose that the observations 2x, (i = 1,2,...,) are arranged in some random order, 
say the order in which they are drawn. Then we may select a particular pair, say the jth 
and kth drawn, and form the ratio 


u’ = (x; —2,)/8, (3) 


where s is the sample standard deviation defined above. It is then easy to show that the 
distribution of w’ is functionally related to that of Student’s ¢. This follows because the total 
sum of squares of deviations from the sample mean, (n — 1) s?, contains the single degree of 
freedom component }(x;—2x,)?, so that 

(n—1) 8? = $(x,—2,)? + X70, 


x* being based on n—2 degrees of freedom and being independent of 4(x;—2,)*. In fact, 
we can write in more detail 


Xo% = Y (az, —%)? + 2(n—2)(Z—z")P/n, 
i+j,k 


with z’ = > x,|(n—2), z" = $(x;+2,). 
i+j,k 


1 (&%j—%)V(n—1) _ tV{2(n—1)} 
It follows that wel . 7 fa, —z,)i = @tn—3H (4) 





where ¢ is based on n — 2 degrees of freedom. If now we consider a particular sample, there 
will be n(n -- 1) different combinations of j and k, each providing a value of u’. These n(n — 1) 
values may be arranged in descending order of magnitude and denoted by 


, , , 
Up > Ug) > --- 2 Un(n—1)- 


Clearly the distribution of u’, determined from (4), for a pair j, k of z’s taken at random will 
be formed from the sum of the n(n —1) equally weighted distributions of up), ..., Uinin—vi- 
The distribution of wu = w/s is the distribution of uj). In so far as there is no overlap of the 
distributions of uj, and w,, (and consequently of uy, and w,, etc.), the shape of the 
distribution of u = wy, will be that of the upper tail of the known distribution of wu’. 


As shown in the Appendix, the maximum value of wp, is {3(n — 1)}*; this arises when the 
configuration of the sample is as follows: 


Mean 
ae 
1 n—-3 2 


For n of moderate size, such a configuration with n — 3 observations having the same or 
very nearly the same value is most unlikely to occur, so that even when u < {3(n — 1)}* the 
overlap of the distributions of u4,,; and u = uw, may be of little importance. 
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Formally, we may say that for any positive quantity U > {3(n — 1)}}, 
Pr {u! > U} = Pr{u’ is uy} x Pr {uw > U} 
= n(n—1) x Pr {u > U} 
or Pr {u > U} = n(n—1) Pr {u’ > U}. (5) 


This means that provided U > {3(n — 1)}*, the upper tail area of the distribution of u = w/s 
can be obtained exactly from that of u’ which, through the relation (4), can be derived from 
the ¢-distribution. Alternatively, we can compute the 100«2% point of u (say u(a, )) 
from the 100«/{n(n—1)}% point of ¢ for n — 2 degrees of freedom, using the formula 


U*(a,n) = 2(n—1) P(a’, v)/{v +(x’, v)}, (6) 


where a’ = a/{n(n—1)} and v = n—2. 

The following table compares at n = 10, 15 and 20 the upper percentage points of u = w/s 
obtained by this method and by that of the preceding section, for a = 0-10, 0-05, 0-025, 
0-01 and 0-005. It also gives the limiting values {$(n —1)}*. It will be seen that at n = 10 
four of the percentage points lie beyond the upper limit for w.,, but that for n = 15 and 20 
all the percentage points lie below this limit. Thus, strictly speaking, the second method 
of determining u(«,n) is not applicable for much of the table beyond n = 10. In fact, 
however, we find surprising agreement between the Pearson curve values and those derived 
from w’ right up to n = 20, suggesting that the probability of uj, falling in the overlapping 
upper tail area of its distribution must be very small. As would be expected, the difference 
between the two results, where it appears, makes the limit ovtained from the w’-distribution 
slightly larger than that based on moments. 


Table 1. Comparison of percentage points for u=w/s obtained by different methods 





Percentage points, u(a, ) Max. 
n Method of derivation value 


a=0-10} 0-05 | 0025 | 0-01 | 0-005 | %f “a 








10 From curve fitted by moments 3-57 3°69 3: 
From wu’-distribution 3-574 3-685- | 3- 








15 From curve fitted by moments 4-02 4:17 4-29 4-43 4-52 = 
From u’-distribution 4-034 4:17 





20 From curve fitted by moments 4-32 4-49 4-63 4-79 4-91 —— 
From w’-distribution 4-342 4-496 4-635+ | 4-799 4-910 5-339 
































4. COMPOSITION OF THE FINAL TABLE 


The results following from the methods of the two preceding sections have been put together 
in Table 6 printed at the end of the paper (p. 491 below). 

For the lower percentage points, the lines corresponding to n = 10, 15, 20, 60, 100, 200, 
500 and 1000 have been computed by the method of § 2, i.e. from the fitted Pearson curves, 
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and the remaining lines by interpolation. The same applies to the upper percentage points 
for n > 20. For n < 20, the values shown to three decimal accuracy are exact, being in every 
case less than the limit {3(n—1)}*, and have been computed from formula (6). For the 
remaining upper percentage points with n< 20, the values yielded by formula (6) were 
reduced slightly, the reduction amounting to either 1 or 2 units in the second decimal. This 
reduction was assessed by smoothing the discrepancies between the two methods shown in 
Table 1. 

We have not attempted to interpolate for n > 200. A rough interpolation can easily be 
made by graphical or other methods, but if more accurate values of percentage points of 
w/s for such large sample sizes were really required, it would seem necessary to compute 
additional values of the higher moments of the range between Tippett’s values at n = 200, 
500 and 1000. 


5. ILLUSTRATIONS OF POSSIBLE USES OF THE TABLE OF PERCENTAGE POINTS 


We have pressed forward with the preparation of this table, involving certain inaccuracy 
for the larger samples, because the practical usefulness of the ratio w/s can only be tested 
with a table available. The following examples illustrate some of a variety of ways in which 
the table might be used, but it must be emphasized that no claim is made that the test is 
better than other simple tests which have been or could be devised. 


(5-1) Testing for lack of homogeneity of data 
As mentioned above Dr Joseph Berkson has made it a practice in course of consultation 
work with laboratory colleagues, to compare standard deviations derived from samples of 
50-200 observations with the range estimate of o found by dividing the sample range by 
factor d,, obtained from Tippett’s (1925) table. He writes: 
‘On occasion there was a considerable difference between the range and mean-square 


estimates and in these instances, almost invariably, further investigation disclosed that . 


either there had been an arithmetic error, or the observations were very different from 
normally distributed; in particular there were one or more observations outlying from the 
rest. This sort of experience, accumulated over a long period of time, built up the impression 
that the range estimate of the standard deviation of a normal distribution was a close 
equivalent of the mean-square estimate.’ 

To illustrate the use of our table in this connexion we have considered some of the 
frequency distributions of physical characters published by Mahalanobis, Majumdar & 
Rao (1949) in the report on an anthropometric survey of the United Provinces of India 
undertaken in 1941. From these data we have taken the frequency distributions of head 
length given for each-of 23 racial groups. (Appendix 7 of the paper and also Tables 2-1 
and 6-1.) The sample size varies from 57 to 197; for each of the 23 groups we have calculated 
the ratio w/s and the results are plotted in Fig. 1 on which are also drawn the upper and lower 
5 and 1% significance levels for the ratio. For these levels, smooth curves have been drawn 
through points taken from Table 6. It will be seen that for five of the twenty-three groups 
w/s falls beyond the upper 5% level and for two of these, well beyond the 1 % level. On 
looking at the original frequency distributions, it was found that in each of these five cases 
there was one or more than one very divergent measurement, always in the sense of a small 
head length. Table 2 gives some idea of the position. 
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ats The notation x, has been used to denote the lowest observation in the sample and 2,; the 
ry ; Jowest but one, except in Group 12 where it represents the lowest but two. The ratios 
he (x; —%)/s and (x;—2,;)/s give some idea of the divergence of the outliers. 

_ | 60 80 100 120 140 160 180 200 
his om T T T T T T 
in 74 e 47 
be 
of | 70 ° "a 
ite 
) ° 
0, est 4% jit 2 2 @ hs 
} 
cy 
ed 
ch | 
is | 
on | 
of 
by e., Ayenit a 
re 45 ° ots i a 2 = 5 200 
at . Scale of sample size n 
= Fig. 1 Head length data for 23 Indian racial groups. 
he 
on ; Table 2. Data from five groups showing abnormal w/s 
se (the measurements of head length are in millimetres) 
} T 
he Group n = 8 w w/s (ay—%)/s | (wy —2%y1)/8 by 
& no. 
ia | 
vd 6 150 186-10 6-94 , 49 7-1 — 5-2 — 2-0 6-82 
7 124 186-94 604 | 45 7-5 —4-6 — 2-6 5-61 
“1 8 187 181-87 588 | 39 6-6 —41 —1-2 4-30 
d 12 173 187-69 6-69 44 6-6 — 3-5 (2)* —1-2 4-46 
mt 15 159 186-85 6-42 | 42 6-5 —3-7 —14 3-72 
7. * Two observations fell at the extreme value of 164mm. 
\n Without inside knowledge of the investigation we cannot, of course, judge whether any 
es ¢ of these outlying readings are due to faulty recording, but had a test of this character been 
nl applied to the distributions originally there would have been a prima facie case for further 


scrutiny of the data before, for example, calculating higher moments. 
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The Indian Report gives also the values of the shape coefficients /b, and 6, for each of the 
twenty-three distributions. Taking 6, as a measure of kurtosis most likely to be related to 
w/s and referring to a table of significance levels to test for departure from normality (see 
Pearson, 1930; Pearson & Hartley, 1954, Tables 34C), it is found that the 5, values for 
groups 6, 7, 8 and 12 are significant at the upper 1 % level and that for group 15 at the upper 
5 % level. Further, none of the other 18 values of b, differ significantly at 5 % level from the 
normal value of £, = 3-0! 

In the present case it would seem probable that departure from normality is due to the 
presence of discrepant observations; under these circumstances there it little reason to 
calculate /b, and 6, which are only useful as measures of shape when dealing with homo- 
geneous non-normal material. However, the similarity in behaviour of w/s and 6b, in the 
present example, suggests that under suitable conditions the former ratio may provide 


a useful and easily calculated measure of kurtosis. An example of this application will be 
considered next. 


(5-2) Testing for kurtosis 
Geary (1935) and Pearson (1935) in a joint investigation used some artificial sampling data 
to compare the efficiency of b, and m/s (i.e. Geary’s (mean deviation)/(standard deviation) 
ratio) in detecting departure from normality. We have now calculated the w/s ratio on the 


same data. These consist of samples of 76 and 300 from the following symmetrical popula- 
tions: 


Population no. Type Be 
I Rectangular 1-8 

II Pearson Type II 2-5 

Til Pearson Type VII 4-1 

IV Pearson Type VII 71 

v Double exponential 6-0 


Table 3. Samples of 76; comparison of test ratios 




















‘ I IV Vv 
Population (rectangular) (Type VII, 8,=7-1) | (double exponential) 
Test ratio used ...| m/s bs w/8 m/s be w/s | m/s b, w/s 
Number of sample points: 
Within 5 % limits 0 0 0 3 2 7 1 1 3 
Between 5 and 1 % limits 2 0 0 1 4 1 1 5 3 
Beyond 1 % limits 8 10 10 6 4 2 8 4 + 



































A comparison of the b, and w/s values for ten samples with n = 76 from populations 
nos. I, IV and V and for six samples with n = 300 from populations II and III is made in 
Figs. 2 and 3. Similar diagrammatic comparisons between 6, and Geary’s ratio m/s were 
given in Pearson’s (1935), Figs. 3 and 4. The high correlation between 6, and w/s will be 
noted, particularly for the platykurtic distributions I and II. The relative power of the three 
ratios in testing for departure from normality is summarized in Tables 3 and 4 as far as 
these very limited sampling results are concerned. It will be seen that the w/s ratio is in 
some cases as effective as the other two statistics, but is never more effective than b,. On 
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this evidence, all that we would suggest is that the use of this very simply computed criterion 
deserves further examination in practice. 

It should be noted, as pointed out by Geary and Pearson that the position of the per- 
centage points for b, with n = 76 were not then and have not since been firmly established. 


Table 4. Samples of 300; comparison of test ratios 





Population ... II (Type II, #,= 2-5) III (Type VII, £,=4-1) 





Test ratio used ...| m/s b, w/s m/s bs w/s 





Number of sample points: 
Within 5 % limits 
Between 5 and 1 % limits 
Beyond 1 % limits 


BO bv 
to 
wwe 
bo bo bo 
wwe 
wwe 





























(5-3) A small sample illustration 


Only experience can show whether the table of limits for w/s will prove useful in detecting 
abnormality in the configuration of small samples. We give here a single example illustrating 
a situation which might arise where some of the observations in a sample are subject to 
greater variability than the rest, but there is no alteration in mean value. 

Samples of 20 values were taken from Wold’s (1948) T'able of Random Normal Deviates. 
In each sample the first 16 values were left unaltered and the remaining four were multiplied 
(a) by three and (b) by four. Thus we have composite samples of n = 20, each containing 16 
observations from a population N(0,o) and four from N(0, ko) with o = 1 and (a) k = 3, 
(6) k = 4. How often will the ratio of range to standard deviation suggest the presence of 
this heterogeneity? The procedure was applied to the first five series of 20 numbers in 
Wold’s table, i.e. to the numbers in the first two columns of his p. 2, 1, 1-20; 1, 21-40; 1, 41- 
2, 10; 2, 11-30; 2, 31-50. The results are shown in Table 5, the significance levels for n = 20 
being found from Table 6. 


Table 5. Test for lack of constancy in standard deviation 











With k=3 With k=4 
Sample 
w/s Significant at w/s Significant at 
1 4-82 1 % level 4-93 0-5 % level 
2 4-70 2-5 % level 4-74 2-5 % level 
3 3-75 — 4-26 —_— 
4 3-98 — 4-06 — 
5 3-61 a 3-45 — 























Evidence of something anomalous appeared in the first two samples, but for the remainder 
w/s was not even significant at the 10% level (single tail test). It is clear that if all four 
observations from the population with larger variance happen to lie near the population 
mean, & very considerable multiplying up of the standard deviation may be required before 












le 








rion 


per- 
hed. 














= —— 





H. A. Davin, H. O. Hartiey anp E. 8. Pearson 491 


any of them becomes an extreme observation in the composite sample. In fact, the range 
may remain stationary and the standard deviation increase until k has become quite large. 
This is the position for the fifth sample in the series. 

If now we combine the five samples into a single sample of n = 100, containing 80 obser- 
vations from (0,0) and 20 from N(0, ko’), we find 


for k=3, w/s = 7-95; for k=4, w/s = 8-72, 


results which both lie well beyond the 0-5% level. With as many as 20 observations from the 
more variable population, it becomes almost certain that there will be some values appearing 
as outliers in the tails of the distribution. 


Table 6. Percentage points of the distribution of the ratio of range to standard deviation, 
w/s, in samples of size n from a normal population 














Size of Lower percentage points Upper percentage points Size of 
sample sample 
” 05 | 10 | 25 | 50 | 100] 100 | 5-0 2-5 1-0 0-5 = 
Skew) J 
| 1-997 1-999 | 2-000 | 2-006 | 2-000 3 
| 2-409 | 2-429 | 2-439 | 2-445 | 2-447 4 
2-712 | 2-753 | 2-782 | 2-803 | 2-813 5 
| 2-949 | 3-012 | 3-056 | 3-095 | 3-115 6 
| 3-143 | 3-222 | 3-282 | 3-338 | 3-369 7 
3-308 | 3-399 | 3-471 3-543 | 3-585 8 
| 3-449 | 3-552 | 3-634 | 3-720 | 3-772 9 
10 2-47 | 2-51 | 2-59 | 2-67 | 2-77 | 3-57 3-685 | 3:777 | 3°875 | 3-935 10 
11 2-53 | 2-58 | 2-66 | 2-74 | 2-84 | 3-68 3-80 3-903 | 4:012 | 4-079 11 
12 2-59 | 2-65 | 2-73 | 2-80 | 2-91 | 3-78 3-91 4-01 4/134 | 4-208 12 
13 2-65 | 2-70 | 2-78 | 2:86 | 2-97 | 3°87 4:00 4-11 4:244 | 4-325 13 
14 2:70 | 2-75 | 2-83 | 2-91 | 3-02 | 3-95 4:09 4-21 4-34 4-431 14 
15 2:75 | 2-80 | 2-88 | 2-96 | 3-07 | 4-02 4:17 4:29 4-43 4-53 15 
16 2:80 | 2-85 | 2-93 | 3-01 | 3-13 | 4-09 4:24 4°37 4-61 4-62 16 
17 2-84 | 2:90 | 2:98 | 3:06 | 3-17 | 4-15 4°31 4-44 4:59 4-69 17 
18 2°88 | 2-94 | 3-02 | 3:10 | 3-21 | 4-21 4:38 4-51 4-66 4:77 18 
19 2-92 | 2:98 | 3-06 | 3-14 | 3:25 | 4:27 4:43 4:57 4:73 4-84 19 
20 2:95 | 3-01 | 3-10 | 3-18 | 3:29 | 4-32 4:49 4-63 4:79 4-91 20 
30 3-22 | 3-27 | 3-37 | 3-46 | 3-58 | 4-70 4-89 5-06 5:25 5:39 30 
40 3-41 | 3-46 | 3-57 | 3-66 | 3-79 | 4:96 5-15 5-34 5-54 5-69 40 
50 3°57 | 3-61 | 3-72 | 3-82 | 3-94 | 5-15 5°35 5°54 5:77 5-91 50 
60 3-69 | 3-74.| 3-85 | 3-95 | 4:07 | 5-29 5°50 5:70 5:93 6-09 60 
80 3°88 | 3-93 | 405 | 4:15 | 4:27 | 5-51 5-73 5-93 6-18 6°35 80 
100 4:02 | 4:09 | 4-20 | 4:31 | 4:44 | 5-68 5-90 6-11 6-36 6°54 100 
150 4:30 | 4:36 | 4:47 | 4:59 | 4:72 | 5-96 6-18 6°39 6:64 6-84 150 
4-78 . 
5:37 
5:79 
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APPENDIX 
Determination of the maximum value of ug, 


Let x; (i = 1,2,...,) denote the values of a random sample of n observations arranged in 

ascending order of magnitude, so that x, is the smallest and x, the largest.* We wish to 

determine the maximum value of the ratio wy; = (%,_, — %,)/8, where s* = >) (x; —%)*/(n—1). 
i 


Since the value will not depend on the origin or scale of the x; we may assume, without loss 
of generality, that z, = 0 and x,_, = 1, so that z,_,—2, = 1 and the maximum of w,, can 
be found by minimizing the sum of squares 


S = (n—1)8? = Xa? —(Za,)?/n. 
This minimum will be found in three stages: 
(1) Witha, = 0,2,_, = land z,, held fixed, S is minimized if all the x; fori = 2,3, ...,.»—2 


—2 
have the same value, say X. For if X = > x,/(n—3), we may write 
i=2 


S = 140845 (e,—X)*+(n—3) X*— (142, + (n—3) X}8/n, 
i=2 


which is clearly minimized if all xz; = X (i = 2,3,...,n—2). 
(2) Confining ourselves to samples in which 2,=0, 7,=X (i = 2,3,...,.n—2) and 
Xp, = 1, we may next show that S is minimized if z, = 1. We now have 


S = 1+22 +(n—3) X*-—(1+2,+(n—3) X)*/n. 


a8 a 
Then i = 2(z,, —%) > 0, 


so that the smallest possible value of z,, namely, x, = x,_, = 1, will minimize S. 
(3) Next, confining ourselves to samples with 


%,=0, 2=2,,=1 and 4,=X (t= 2,3,...,n—2), 
we must find the value of X which minimizes S. Clearly now 
S = 24 (n—3) X2-(2+(n—3) X)2/n, 
an expression which is easily found to have a minimum at X = 2. For this we have 
S = 2+4(n—3)—(2+4 (n—3)8)3/n = 8. 
Hence 8? = §/(n—1) = 2/{3(n— 1)}, 
and the maximum value of wu», is {(n — 1)}*. 


For this configuration maximizing u;., we have a single observation at one extreme of 
the sample range, two equal observations at the other extreme and the remaining n—3 


observations together at the mean of the whole, i.e. at a distance two-thirds of the way 
bety en the first extreme and the second extreme. 


* Note the change from § 3, where the observations were taken in random order. 
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SAMPLING WITH CONTROL VARIABLES 
By E. C. FIELLER anp H. 0. HARTLEY 


1. The use of control variables in certain types of sample surveys is a well-known 
procedure. For example, if we wish to estimate the population mean 7 of a variable y, and 
can observe concomitantly a ‘control variable’ x for which the population mean é is known 
exactly, then with the help of the sample estimate of the regression of y on x we may estimate 
n as 7¥+b(—-Z). If x and y are highly correlated, this adjusted estimate will usually have 
considerably higher precision than the simple estimate 7 of 7. Methods of sample survey 
employ numerous alternative procedures for utilizing a ‘control variable’ x correlated with 
the variable y for which estimates are required; we may mention here the well-known devices 
of ‘ratio estimates’ y/x, and that of a ‘post-stratification’ of y with regard to z. 

2. In the study of frequency distributions by experimental sampling, we aim at esti- 
mating a set of relative frequencies in an unknown population from the observed proportions 
in a sample. It is well known that very large samples, NV, are required in such a procedure, 
since the standard deviations of the estimates normally decrease only as 1/,/N. The advent 
of high-speed electronic calculators has, however, opened up the possibility of tabulating 
mathematical distributions to low decimal accuracy with the help of these methods, which 
are nowadays often referred to as ‘Monte Carlo Calculations’. Nevertheless, the expense 
and effort of such calculations make it imperative to seek for methods of improving the 
low precision that they normally yield. It is natural, therefore, to ask whether the estimation 
of the theoretical frequency distribution of a variable y by sampling cannot be improved 
with the help of a control variable x, the true distribution of which has been previously 
determined. 

In this note we discuss the use of such control variables in this way, and show that the 
resulting gain in precision may well be considerable. Indeed, it will be seen that with the 
help of the technique discussed, the value of the sample, as judged by the precision of the 
estimates derived from it, may often be increased three to fivefold at the cost of relatively 
little extra calculation. 

The problems that we consider presented themselves to us, and are discussed in the 
following paragraphs, from the point of view of the empirical study of sampling distributions. 
It will be apparent, however, that the results at which we arrive may, in suitable circum- 
stances, be applied in any sampling survey, the objective of which is to study the distribu- 
tion of some characteristic in the population sampled. In this connexion the method is 
related to the device known as ‘ Double Sampling’ (Neyman, 1938). 


3. By way of illustration, we consider the sampling experiment summarized* in Table 1. 
N = 1000 samples of 5 (X,, X,,...,X;) were drawn, with the help of Hollerith equipment, 
from a normal parent population with unit standard deviation (Wold, 1948). Table 1 gives 
(at rather wide intervals) the joint distribution in these samples of the two statistics 


y = the sample range = Xyay — Xmin. 
and a = the sum of squared deviations = £(X,—X)?. 


* The fractional group frequencies for z = y* have arisen from the use of percentage points of y? for 
the group end-points. 
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The expected marginal frequency distributions were calculated from tables of the ‘x? 

probability integral and tables of the probability integral of the range (Pearson & Hartley, 

1954, Table 23), respectively. In both cases the agreement of observation with theory is 

extremely good, the respective values of x? for goodness of fit being 3-64 for y and 8-46 for x, 
each for 5 degrees of freedom. 


















































nown Let us now assume, for the sake of illustration, that the theoretical distribution of the 
, and range y is not known, and that we wish to estimate from the data in Table 1 the relative 
nown | frequencies with which y falls into the six intervals 0 to 1, 1 to 2, etc., used in the com- 
rate pilation of Table 1. The observed marginal proportional frequencies 0-0560, 0-3305, ... are 
have | of course themselves one set of estimates, whose precision is given by the familiar formula 
irvey for the binomial variance; but the question arises, whether we can utilize our exact know- 
with ledge of the expected x-frequencies to obtain other estimates of the y-frequencies that are 
vices of higher precision. 
esti- Table 1. Joint distribution of range (y) and reduced sum of 
tions } squares (x) in 1000 samples of 5 
lure, 
vent -poi i 
Deitel laiiehs Group end-points for sum of squares (x) Total frequencies for y 
. mg points for 
hich | range(y) | gq 071 2-75 488 9-49 14:86 co | Observed|Expected| Nj,, 
ense , 
; the 0 
ti 1 49-5 6-5 56-0 45-0 51-8 
tion - 5-0 | 305-0 | 20-5 330-5 | 336-6 | 327-9 
ved 3 39-0 306-0 69-0 414-0 407-5 396-0 
usl 4 2-5 142-0 18-5 163-0 173-2 184-8 
| : 10-0 | 195 | 40 33°5 34-0 37-3 
} 3-0 3-0 3-7 2-1 
ioe) 
‘the | 
the Totals 
the Observed | 54-5 350-5 329-0 221-0 38-0 7-0 1000-0 (999-9) 
vely Expected 50-0 350-0 300-0 250-0 45-0 5-0 1000-0 
th 
e " 
wale Let us denote by n,; the frequency with which, in a sample of N, the observed (y, x) pairs 
muy | fall in the ith y-category and the jth x-category (i = 1,2,...,m;j = 1,2,...,4; Sm; =), 
y ; 
bu- and write the marginal frequencies as n_; = Dn,;,;,= X7,;. Likewise, let us denote by 
d is y J 
| p;; the unknown probability that the pair (y, x) falls in the 7, jth cell, and write p_; = 2 Diy, 
i 
el. py. = ~ p,; for the marginal probabilities. Now the product p_;(m,;/n_;) is clearly an unbiased 
nt, ) estimate of the cell probability p;,; involving the known p _, and an estimate n,,/n_; of the 
- conditional probability p,,/p_;. The n,;/n_; are in fact maximum-likelihood estimators of 
the p;,/p_,; for those columns for which n_;>0. No such estimators of the p;,/p_; are available 
for those columns for which n_; = 0. If in these latter cases we use the marginal ratio n, /N 
} as an estimate of p;,/p_; we reach as an estimate of p;_ the sum of products 
for , - nln; if n,>0, 
- = . 2 = M re l 
D;.= XI p5;uj, Where uj; n,|N if n4=0. (1) 
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In the case of our example, the ‘revised’ values of the y-frequencies derived from formula 
(1) are given in the final column of Table 1. These revised values do not appear, at first sight, 
to improve greatly on the original estimates Np, ; if they are formally compared with their 
expectations by x, we obtain 3-37 against 3-64. The justification for preferring the revised 


estimates ND, is provided, however, by an examination of their statistical properties. 
We note in the first place that 


= A 

=P. Le. (2) 
and Ps.) = Pi. LT (Pis— PsP.) (3) 
where q.3=1-p,;. 


The first property (2) is obvious from (1), and the second (3) follows from an evaluation of 
E(u,;). We have 


E(u,;) = Pr. {n_5>0} p,j/p_5+ Pr. {n_;=0} (p;,—Diy)/(1—P.5) 
= (1-9) Dis P.5 + 7( Pi. —Piz)/(1—P.5) 
= PislP. 3+ V5 ( Di. — Pis|P.4)s (4) 
and (3) follows from a combination of (1) and (4). The bias of ;_, given by  gN—(_p,; —9;..;) 
j 
is of the order of magnitude of > e—?j, and is clearly negligible if it is arranged that all 
j 


expected x-frequencies Np ; are, say, >8. This can be done in advance of sampling, since 
the p_; are known. 


4. Weturn now tothevarianceof, ,and to this end require the variances and covariances 
of the u,;. We have 


E(ui;) = E (ui; |n_;>0).(1—gh) + &(u2, | n_,=0).9% 


= A ~ B (say). (5) 
Now since for any fixed n_;>0 we have 
’ Aa .\2 
E(u2,|n = Put (1 But) © + (Pe)’, 6 
(wis | ? P.3 Py] 2,3 J (9) 
7 = 4\2 
it follows that A = Ebi (. —P| +(1—qX) (22) r (7) 
P.3 P 3 Pj 
, U N 1 N F 
where B= E'\Np.N)= & (yan, (8) 
nj=1Nj Nj 
To evaluate B, we note that if we are given that n_,; = 0, we have 
us =n, |N = ¥ ny/N. (9) 
+i 
Using the variances and covariances of the n,;, we find 
E (ui; |n,5=0) = (Dy. —Di)*/¢?, + O(N), (10) 
\2 
so that (ut) = BP (1—P4) + (1 9%)(24)' +95-%(p, py OW-e3). (11) 
Jd J ) 


Applying the correction for mean from (4), we obtain, after some rearrangement of terms, 


. ss 2 
var (u,;) = RP (2 -Pu) +95-*(p,,—Be ) +O(N-1q%) + 0(q%"). (12) 
Pi; Pj P35 
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By a similar procedure it can be shown that the covariances of u;;, and u,;, are of the order 
0(¢%,7%,), and can therefore be neglected. 

To evaluate var (~;_), we now need an approximation to the quantity H’ defined in equa- 
tion (8). This quantity, the expectation of the reciprocal of a binomial variate excluding the 
zero Class, is of importance in many aspects of sampling survey theory, and it has seemed 
worth while to study it in detail in an Appendix to this paper. For our present purpose, it is 
sufficient to use the approximation provided by the expansion (9) of the Appendix, namely, 


HE’ = [Np 5+. 5/(Np_;)? + O{(Np_ ;)}. (13) 
Using the first two terms in.(12) and (13), and substituting (13) in (12), we obtain 
var (D;,) ~ a{Pi; var (u;5)} 
= Pil Pi N — 3B (Pis— PsP .sVINP.5 
+ 2 P49.9(1 —DijlP.3)|N*p 5+ ~ qs *( Dis —Di.P.5)* 
=I+II+ITI+IV, say. (14) 


In comparison with I and II, which are each of order 1/N, the terms ITI and IV in (14) may 
be ignored. The leading term I is the binomial variance of the unadjusted estimate p, , 
and the second, II, representing the gain in precision due to the use of ; in place of p, , 
may conveniently be termed the ‘variance reduction’. 

This latter term is zero if p;; = p;_p_;, i.e. if x and y are independent, so that no gain in 
precision is achieved in this case. If, on the other hand, there is ‘perfect dependence’ 
between y and z, i.e. if there is a one-to-one correspondence of i and j such that p; =p,;=p_; 
and p;;=0 for all other combinations of i and j, then var(),;_) vanishes. In general, the 
reduction term II will lie between zero and I, and if x and y are highly correlated there will 
usually be a considerable reduction in var (%, ) compared with the binomial variance I. 


5. Table 2 shows the extent to which, in the sampling experiment summarized in Table 1, 
the process of adjustment has increased the reliability of our estimates of the proportionate 
frequencies in the distribution of y. The relative efficiency of the ); , calculated as 
var (p;_)/var(,_), ranges in the six groups from 150 to 480%. It will be seen from the last 
two columns in Table 2 that the error in the adjusted estimates ); is about twice the 
standard error of #; in the first frequency group, and of the order of the standard error in 
the remaining five groups. 


Table 2. Relative efficiencies of the estimates given in Table 1 











Estimated variance Esti 
Group end- Relative stimated Difference 
points for efficiency standard error fy, — true p 
range (y) * of p,, i. ‘. 
var (9;,) var (0;,) 
; 0-053 0-011 4-8 0-0033 0-0068 
2 0-221 0-063 3-5 0-0079 — 0-0087 
3 0-243 0-104 2-3 0-0102 —0-0115 
4 0-136 0-063 2-2 0-0079 0-0116 
5 0-032 0-021 1-6 0-0046 0-0033 
po 0-003 0-002 1-5 0-0014 —0-0016 


























32-2 
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6. The ‘variance reduction’, var(p,; )—var(p;), depending as it were on the strength of 
the association between the primary variable y and the control variable z, can be related 
to the classical measure of ‘mean-square contingency’ introduced by Karl Pearson. In 
fact it follows from the first two terms in (14) that the proportional variance reduction for 
the ith y-group is 


AS ~ yyy (Dis Pi.P 5)” 
1—var (B,,)/var(p,,) = Boe. 


If we weight these by the quantities (1—p, )/(—1) and sum, we obtain 


1 (Py-Pi.P.s?_ # 
k-lig Ds k—-1 


in Karl Pearson’s notation. 

The mean-square contingency, like the second member of (14), depends on a knowledge 
of the p,;; and while the sampling experiment will in due course provide estimates of these 
joint probabilities, they will not be available for an a priori assessment of the value of a 
proposed control variable. A study—not reproduced here—of the early work on the mean- 
square contingency (K. Pearson, 1913) suggests that if the quantitative variates x and y 
follow approximately a bivariate normal distribution with correlation p, and if the z and y 
scales are each divided into the same number k = m of group intervals of equal probability, 
then the ‘average variance reduction’ should be given approximately by 


p*/{k—(k—-1)p%. (15) 


Here, as above, the ‘average variance reduction’ is defined as the weighted average of the 
individual proportional variance reductions {var (p, )—var(D,_)}/var(p;.), with weighting 
coefficients (1—p, )/(k—1). Numerical examples that we have investigated indicate that 
formula (15) is sensitive to departures from the conditions stated above; nevertheless, it 
may on occasion serve as a useful guide at the start of a sampling experiment. It requires 
a knowledge only of the product-moment correlation between x and y, which if not known 
a priori may be estimated from a pilot experiment. As we would expect, (15) indicates that 
for p? = 0 there is no reduction in variance, while for p? = 1 the proportional reduction is 
unity, i.e. the variances of the ; are all zero. 

7. It should be noted that the formula (15) indicates that for given p the proportional 
reduction in var(p,_) is larger for small k, and for large k tends to zero. This is borne out, 
more generally, by numerical experiment on the basis of (14). Thus the method of using 
control variables will in general be more effective, if the number of frequency groups k is 
small, always provided that this reduction is otherwise acceptable. To illustrate this we 


may, for example, pool the frequencies in Table 1 to form, after division by the sample size, 
the two-by-two table: 














O<x<2-75 2-75<x<0 Totals 

O<y<2 0-3660 0-0205 0-3865 

2<y<o 0-0390 0-5745 0-6135 
e oe 

Totals 0-4050 0-5950 1-0000 
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The proportional reduction in variance now assumes the simple form 


(Pi —P1.P.1)?/P1.P.1P2.P.2 
which in the above example has the value 0-768, so that we have a relative efficiency of 
100/(1— 0-768) = 431 %. 


APPENDIX 
The first negative moment of a binomial variate 
In the preceding paper (see equations (8) and (13)) we have quoted an approximation to the sum 


n 1/(n 
E'(np,n) = X - ( Jeo, (1) 
r=1T \r 

which is the expectation of the reciprocal of a binomial variate, excluding the zero class. For small 
values of n, HE’ can easily be computed directly from existing tables of binomial terms (National Bureau 
of Standards, 1952).* In this Appendix we discuss its evaluation for large values of n, arriving in 
particular at the approximation already mentioned. 

It is convenient to consider first the limiting case of the Poisson distribution, with mean m say, for 
which the analogous sum is 





© lm’ ™m™ te] 
E’(m, 0) = e-™ & Lng wl emf : dt. (2) 
r=17r 7! o «(¢ 


This integral may be expressed (Bromwich, 1926) as 


m 0 gt] , 
f -{ dt = Ei(m)—log,m—y, 
—@% 


= © 





where y is Euler’s constant 0-57721..., and Ei (m) is the logarithmic integral 


™m et 
—-o 
Thus Z’(m, 00) may be calculated as 
E’(m, 0) = e-™ {Ei (m) — log, m—y} (3) 
from the tables of Ei (x) provided by the British Association (1931) or by Jahnke & Emde (1952). 
Replacing the logarithmic integral in (3) by its well-known asymptotic expansion gives, for large m, 
1 ! 
E’(m, 0) +e-™ (log, m+y) = —+—+—+- (4) 


a series that yields maximum accuracy if we retain its terms until they start increasing. 
Returning to the binomial distribution, we may clearly rewrite (1) as 


pia (1 n—] 
E'(np,n) = q" } te sot 1 (5) 
0 u 
pla In)® — 
The substitution u=t/n gives EH’(np,n) = a oer dt, 
0 


a form the limit of which, if n > oo and p->0 so that np >™, is the integral in (2). The alternative sub- 
stitution u = (p—t)/q transforms (5) to 





7-9" 
E’ ? =-_— pete: ae ? 
yar “| o p-t 
or, on integrating by parts, 
E'(np,n) = — [Pa —t)"— log (1—t/p) dt, (6) 
0 


since the additional term {(1—t)"—gq"} {log (p—t) — log p} resulting from the partial integration vanishes 
at both limits. 


* Since this note was first submitted, Grab & Savage (1954) have published tables covering the ranges 
n = 2(1)30 for the binomial and m = 0-01, 0-05 ( -05) 1-00 (-10) 1-80 for the Poisson distribution. 
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Expanding the logarithmic term in (6), we express Z’ as a series of incomplete beta-functions* 
EE’ (np, n) . I,(2,n)+ M I ,(3,) + » 

9 a. "= ’ a. + ae of jae eo 

Beh piney pans Be Dn +8 


where s stands, as usual, for s!/(s—¢)!. For moderate values of n, E’(np, n) might be calculated from (7) 
with the help of the available tables (Pearson, 1934); for large values of n and those values of r for which 
r/n<p, I,(r,) is almost unity, so that if we write m for np, (7) suggests, in analogy with (4), 


I,(4,n) +... (7) 


l! 2! 
— = ee 8 
mp * (m+ p)(m+ 9p) * (m4p) (m+ 2p) (m+ Bp) * (8) 


This result is established more rigorously below; we remark now that it can easily be verified that as 
far as terms of order (m—q)-*, (8) is equivalent to 


E’(m,n) = 





1 q q(q¢+1) 1 , am+1) 
E'(m,n) = —— + ——. =—+ , (9) 
ae m—q (m—q)® (m—q)* m—q (m—q)* 
a convenient form when m is large and q small. 


To obtain a more accurate asymptotic expression for H’, we consider the sum of the first s terms in (7), 
which may be written as 








1 t? 

Ey(np,n) = »p| (1—pt)"-} (++ i+... 2) at (10) 
0 

A first integration by parts gives 


1 1 
BXnpyn)+ar(1+4+...+2) = [ (1—pt)"(L+t+...+0-) dt; 
70 


after u further integrations by parts we shall arrive at an integral term 
1 1 
ara, (1—pt)"* {u! +(ut+ IMt+...4¢(e— 1)™ ¢-*—-1} dt, 
and after one more integration at an additional term 


-1 
aad pei pen (pent (ut + (ut E+... +(e— Lye 





= {u! ws gutlgntutl (ay + 1)}/p**+1(n +ut+ 1)(¢+», 
It follows that 


E(np,n) +ar(t +$+... +) = S iw — 1)!— sgt" /u}/p*(n + u)™). (11) 
uU= 


If we write m for np, take s = m,, the largest integer not exceeding m, replace the harmonic sum in (11) 
by its asymptotic value and ignore the difference between Ey, and HE’, we arrive at the analogue to (4) 


™ 
E’(m,n) + q"{(log,m, + Y) + & (ap mi? /u(n + uy} 
ux 





1 l! 2! 
~—+ +— +...to m, terms. (12) 
+p (m+p)(m+2p) © (m+p) (m+ 2p) (m+ 3p) ; 
™, «o 
Since >» (q/p)*m@ /u(n +u) < X g*/u = —log, p, 
u=1 u=1 


the second term in the first member of (12) is certainly less than g"(log,n+/). 


The entries in the accompanying table of Z’, computed by Miss Pamela Johnson, were obtained as 
follows: 


m = 1(1) 10, n = 25, 50 directly from equation (1); 
m = 12(2) 20, n = 25,50,100\ from equation (8), 

25 (5) 45, 50, 100 } controlled by equation (12); 
m=1(1)10(2)14, n=o from equation (3), 
m = 16(2)20(5)45, n= from equation (4). 


* Stephan (1945) has given a result equivalent to (7), with the incomplete beta-functions replaced by 
the corresponding binomial tails; he has also shown that the series in (7) converges, and how it may be 
used for accurate calculation. 
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For the values of m listed, and intermediate values of n, Z’ may be found by harmonic interpolation. 
For m> 1 and n> 100, E’(m, «), calculated from equation (3) or (4), clearly provides a reasonably good 
working approximation to E’(m,n). For m>4, this approximation may be improved by linear inter- 
polation, with p = m/n as interval, between E’(m,0o) and E’(m,m) = 1/m; the error in the interpolate 
for m = 5, n = 100, for example, is about 0-0004, and for m = 25, n = 100 about 0-00002. 


» Lf/n 
Values of E’(np,n) = & ( )ero 
r ¢ 


=17 











m n=25 n= 50 n= 00 m n= 25 n= 650 n=100 n=0O 
| 

1 0-4932 0-4890 0-4848 12 0-:08752 0-08964 0-09074 0-09190 
2 -5051 -5018 -4986 14 -07395 -07567 -07656 -07749 
3 4096 -4105 4111 16 -06404 -06549 -06624 -06702 
4 -3160 +3200 +3236 18 -05649 ‘05774 -05839 -05906 
5 +2460 *2511 +2560 20 -05053 05164 -05221 -05280 
6 0-1972 0:2023 0:2073 25 0-04000 0-04085 0:04129 0-:04175 
7 -1632 -1678 *1723 30 — -03380 -03416 -03453 
8 +1390 -1429 -1468 35 — -02883 -02913 -02944 
9 *1211 +1243 *1277 40 — -02513 -02539 -02566 

10 -1073 “1101 -1130 45 — *02227 -02250 -02274 



































1 q q(q+1) 
For large m = np, E’ ~ —— ; 
or large m = np aa tae ee 





This paper was in part prepared in the Statistical Advisory Unit, Ministry of Supply, and is 
published with the permission of the Ministry’s Chief Scientist. 
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RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS 
II. ADDITIONAL TABLES FOR THE METHOD OF PAIRED COMPARISONS 


By RALPH ALLAN BRADLEY* 
Virginia Agricultural Experiment Station of the Virginia Polytechnic Institute 


1. INTRODUCTION AND SUMMARY 


The purpose of this paper is to provide additional tables for the method of paired com- 
parisons introduced by Bradley & Terry (1952), and it is not our intention to review the 
theoretical aspects of that method. An illustration of the use of the method is included in 
the cited reference, and a more detailed application was presented by Terry, Bradley & 
Davis (1952) for the use of food technologists. Additional research has been conducted by 
- Bradley (1954) on the appropriateness of the model for paired comparisons and by Abelson 
& Bradley (1954) on factorial arrangements of treatments in paired comparisons. 

In paired comparisons we use ¢ to denote the number of treatments or items to be com- 


pared, and we define a repetition to be a single set of the (;) treatment comparisons. 


A repetition may then be regarded to be a single set of incomplete blocks of size two with 
pairs of treatments appearing together once and only once in the incomplete blocks of the 
set. The number of repetitions in a paired comparisons experiment is represented by n. 
Tables for paired comparisons for t = 3, n = 1, ..., 10, and for t = 4, n = 1, ..., 6 were in- 
cluded in Appendix A of the initial paper on the subject (Bradley & Terry, 1952). For experi- 
ments in which ranks are assigned to the treatments within the incomplete blocks, these 
tables show the distribution of a statistic, B,, used for a test of treatment equality, along 
with estimates, p,,...,,, of postulated treatment parameters, or ratings, 7,,...,7,. When 
a single set of treatment parameters is sufficient to characterize the rankings in all repetitions 
of the experiment, we say that the n repetitions are a homogeneous set. If the treatment 
parameters are permitted to differ for different repetitions or groups of repetitions of the 
experiment, one is in effect admitting the possibility of ‘treatment by repetition’ or ‘treat- 
ment by groups of repetitions’ interaction. The tables of Appendix A provide means for 
a valid test of treatment equality under the assumption that the n repetitions in the experi- 
ment are a homogeneous set. A second table, that in Appendix B of the same paper, provides 
some significance levels for Bf, the combined likelihood-ratio statistic, which was formulated 
to provide a test procedure for a test of treatment equality, admitting possible treatment by 
repetitions (or groups of repetitions) interaction. The detection of treatment by repetition 
interaction may be accomplished using the test of agreement previously presented. 
Interest in and extensive use of the method of paired comparisons formulated has 
encouraged the author to provide additional tables. In this paper the table of Appendix A 
has been extended for t = 4 to n = 7,8, and to t = 5,n = 1, ..., 5. These tables are volu- 


* This paper reports research undertaken in co-operation with the Quartermaster Food and Con- 
tainer Institute for the Armed Forces and has been assigned number 454 in the series of papers approved 
for publication. The views or conclusions contained in this report are those of the author. They are not 


to be construed as necessarily reflecting the views or endorsement of the Department of Defence of the 
United States of America. 
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minous, and the cost of further extensions was prohibitive with the computing equipment 
and resources available. However, these tables may be sufficient for, with t = 3,4, or 5, it 
appears that the approximate methods previously presented will be adequate for values of 
n beyond the range of the tables, and, for more than five treatments, it may be more desirable 
to use incomplete blocks of size greater than two. No additional tables for Bf could be 
computed, and again approximate methods may often be used. 

In addition to the new tables in the Appendix of this paper, we include some notes on the 
uses of the tables and some minor corrections to the previously published tables. The 
statistic B, is a monotone function of a likelihood-ratio statistic which has been shown to 
have a limiting x*-distribution. For all of the available tables we have computed the 
actual means and variances of the corresponding likelihood-ratio statistics and the con- 
vergence of these values to their limits is illustrated in Table 1. Certain checks on the 
computing were possible, and these have been noted as of interest to the reader. 


2.. USES OF THE TABLES 


t 
Parameters, 7, ...,7,, with 7;>0,7 = 1,...,t, © 7; = 1, are associated with ¢ treatments 
i=1 


in paired comparisons. These parameters are further defined with the assumption that, 
when treatment i appears with treatment j in a comparison, the probability that treatment 
i obtains top rating (or a rank of 1) is 7,/(7;+7,;). Maximum-likelihood estimators of these 
parameters are respectively p,, ..., p,. Analysis of paired comparisons depends on ir,,..., Ir, 
the set of total sums of ranks for the ¢ treatments after ranking has been effected indepen- 
dently within the blocks of size two (the rank 1 was assigned to the ‘better’ of the two treat- 
ments in a pair and the rank 2 to the ‘poorer’). The statistic B,, for tests of treatment 
equality assuming homogeneous repetitions of paired comparisons, has the form* 


B, = n> log (p;, + pj) — X {2n(t— 1) — Xr;} log p;. (1) 
i<j i 


The tables in the Appendix show all possible sets of sums of ranks, =r,, ..., Xr, for specified 
values of ¢ and n, the corresponding sets of estimates, p,, ...,,, values of B,, and the signi- 
ficance levels of B,. It has been indicated (Bradley, 1953) that log p,,...,logp», may be 
regarded as estimators of treatment locations on an additive continuum. 

The basic purpose of the prepared tables is the analysis of paired comparison experi- 
ments with homogeneous repetitions. However, for this purpose alone and with only the 
objective of determining significance levels for the test of treatment equality, it would be 
sufficient to list the sets of sums of ranks and their significance levels. To extend considera- 
tion to the problem of estimation, we also list the estimates of treatment parameters, 
P,-+->P It is useful to list these estimates since their computation is troublesome. The 
statistic B, is used to order the rows in the tables and is not otherwise required in either the 
test or estimation. But values of B, have been given since they are used in certain approxi- 
mate tests. 

The statistic B, is required for: 

(1) The combined test of treatment equality. 

(2) The test for homogeneous repetitions. 

(3) The test of the appropriateness of the model. 

(4) The analysis of paired comparisons with treatments in factorial arrangements. 


* We use log to represent a common logarithm and In to represent a natural logarithm. 
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This list indicates some of the further uses of the tables which we shall discuss briefly. 

(1) Suppose the experiment with repetitions is subdivided into g groups of repetitions 
with n,, repetitions in the wth group, u = 1,...,g. If the » repetitions were assumed to be 
homogeneous, treatment parameters could be limited to 7,, ...,7, and the grouping could 
be ignored. When group differences enter, we postulate parameters 7,,,, ..., 7, for the uth 
group and allow the parameters to vary from group to group. To test for treatment equality 
with the more general alternative specification of the parameters, we use the statistic 


By = & By, (2) 
u=1 
where By; is the statistic B, for the uth group. The tables are then used to obtain values of 
Bi for the computation of Bf. Limited tables for Bf have been published, and an approxi- 
mate test depending on y? with g(t—1) degrees of freedom is available. Reference is to 
Bradley & Terry (1952, p. 332). 

(2) Sometimes it is necessary to decide between the postulation of one set of parameters, 
71, -+-,7, under the assumption of homogeneous repetitions and the use of g sets of para- 
meters needed when repetitions are grouped. Decision is possible using a test of agreement 


ae —~2IndA = 2(B,—Bé)In 10. (3) 


This statistic has a distribution approximated by that of y? with (g—1)(t—1) degrees of 
freedom. B, is read from the tables for the total n repetitions and Bf also depends on the 
tables through (2). Reference is again to Bradley & Terry (1952, p. 332). 

(3) Consider n homogeneous repetitions of paired comparisons and let us define f;; to 
be the number of times treatment i obtains the rank 1 in direct comparison with treatment j. 
Sis t+Sig =n. A test of the appropriateness of the model, or of goodness of fit, for paired 
comparisons has been devised and depends on the statistic 


—2IndA, = |, -n(;) logn+ > flow fs In 10, (4) 


4, ij 
Again B, is required from the tables. Reference is to Bradley (1954). 

(4) The analysis of paired comparison experiments with treatments in a factorial 
arrangement has been developed. At the present time easy analysis seems to be limited to 
the 2 x 2 factorial. Treatment parameters, 7,,...,7,, are replaced by the products of para- 
meters, &,/;, &,f2, af, and @,/, a,+a,= 1, 2, +f, = 1, a;>0, £;>0, i = 1,2, for treat- 
ments composed of A- and B-factors, each at one of two levels. The first step in the analysis 
depends on the statistic B, for an over-all test of treatment effects. The statistic used has 
a distribution approximated by that of vy? with three degrees of freedom. These three degrees 
of freedom may be partitioned in two ways, but in both cases one degree of freedom is used 
to measure A by B interaction. The measure of interaction is a statistic that depends again 
on B, along with maximum-likelihood estimators of «,, %, 8, and £,. Reference is to Abelson 
& Bradley (1954). 

In some cases n may exceed values for which tables have been prepared while the value 
of t is among those tabled. The available tables will still be of considerable assistance. In 
the special case where =r,,..., Zr, and n are all multiples of an integer c, it is sufficient to 
enter the table for ¢ treatments and n/c repetitions with sums of ranks, =r,/c, ..., Z7,/c. 
Values of p,, ...,, may be read directly from the table, and the desired value of B, may be 
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obtained by multiplying the tabular value of B, by c. The test is completed by substituting 
the value of B, so determined in 
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—2InA, = nt(t—1)In2—2B,In 10. (5) 


This statistic has the distribution of y? with (t— 1) degrees of freedom for large values of n. 
When n/c is an integer, and if tables are available for n/c repetitions and ¢ treatments, even 
though =r,/c..., Z7,/c are not all integers, the prepared tables may be used to interpolate 
for values of p,,...,p,. The best results will be obtained when c is the smallest integer for 
which n/c is tabled. These values of p,, ..., p, may be regarded as a first approximation, and 
the final values are computed using the iterative procedure outlined by Bradley & Terry 
(1952). It is then necessary to compute B, using (1) and to complete the approximate test 
using (5). Alternatively, one may interpolate for the value of B, with n/c repetitions, com- 
pute the required B, by again multiplying the tabular value by c, and substitute in (5) for 
the approximate test. This second alternative will be satisfactory if values of p,, ..., p, are 
not required. 

Apart from the direct applications of the tables to methods of paired comparisons out- 
lined above, the tables give the distribution of possible sets of sums of ranks in paired 
comparisons. Under the hypothesis of treatment equality, all permutations of sums of 
ranks in a set are equally likely and their individual probabilities may be recovered from the 
cumulative probabilities tabled (sets of sums of ranks with identical values of B, also have 
identical probabilities). These tables may then be useful ifnew methods of paired comparison 
are devised and even though the new methods may re-order the sets of sums of ranks. 


3. TABLE ACCURACY AND COMPUTING CHECKS 


The method of computing employed has been outlined by Bradley & Terry (1952). Pro- 
babilities were obtained by the method indicated in Table 1 and estimates, p,,...,9,, by 
the iterative procedure set forth in § 10 of that reference. All computations were done with 
the use of punch-cards and I.B.M. equipment with the exception of those on values of B, 
which were obtained using desk calculators. Values of p,,...,p, were obtained correct to 
four decimal places, but they have been rounded to two places to facilitate publication. 
Similarly, values of B, have been rounded to three places from initial computations which 
showed four decimal places. Probabilities or significance levels are correct to four decimal 
places as shown. 

Certain checks on the computations are possible. In the tables certain entries are grouped. 
These sets of sums of ranks yield identical values of B, and also have identical probabilities 
of occurrence. Except for a few symmetric sets of sums of ranks, which stand as single-table 
entries, sets of sums of ranks may be paired and their values of B, should match. The 
relationship that exists between paired sets of sums of ranks is as follows: with n repetitions 
with ¢ treatments, the set of sums of ranks, 7,,..., &7;, has, as a mate, the set 3n(t—1)—2n, 
..., 8n(t—1)—r,. For all such paired sets of sum of ranks, values of p,, ...,p, and B, were 
computed separately for each member of the pair and the resultant values of B, were 
compared. Some sets of sums of ranks are symmetric and have no mates. This occurs when 


3n(t—1)—Un_j 4 = Ur; (= Pal 


For such table entries, all computations were independently repeated. 
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As a secondary check on the tabling, the sum of squares of the sums of ranks in each set 
was computed. This statistic does not order the sets of sums of ranks exactly as does B,, 
but the orderings agree quite closely. Thus, after ordering using B,, if we found a value of 
a sum of squares much out of order, the calculation leading to the corresponding value of 
B, was checked. All sets of sums of ranks grouped together in the tables have equal values 
of the sums of squares of sums of ranks. 

The number of possible decisions on rankings in a paired comparison experiment is 
2im-), and the number of these leading to an ordered set of sums of ranks was used to 
compute the probability of obtaining such a set under the hypothesis of treatment equality. 
These frequencies were used to obtain the means and variances of B, and thence of —2InA, 
given in (5). The results, based then on the tables, are given in Table 1 of this paper and 
indicate the convergence of these means and variances to the corresponding means and 
variances of the appropriate y?-approximation. This table has two purposes. It gives some 
assurance in the use of the approximate test for values of n exceeding those in the tables. 
It also has been of some use as a further check on the computations and this led to one or 
two corrections to the tables. 


Table 1. Means and variances of —2log,A, 























s=3 t=4 t=5 
v ] 
Mean Variance Mean Variance Mean | Variance 
1 3-12 3-24 4:55 9-96 5-61 16-06 
2 3-39 7-27 3-59 9-51 4-58 11-13 
3 2-80 7-50 3°33 7-80 4-32 9-57 
4 2-54 6-51 3-22 7-10 4-23 9-01 
5 2-40 5-83 3-17 6-76 4-18 8-77 
6 2-32 5-38 3°14 6-61 — —_ 
7 2-27 5-15 3-12 6-51 — — 
s 2-23 4-95 3-11 6-45 _— — 
9 2-20 4-82 — — — -- 
10 2-18 4:71 — — —_— — 
co 2-00 4-00 3-00 6-00 4-00 8-00 

















4, EXTREME SETS OF SUMS OF RANKS 
The smallest sum of ranks that a treatment may have with ¢ treatments and n repetitions 
is n(t—1). When this value occurs, the set of estimates, p,,...,p,, has values, 1,0,...,0. 
Substitution of these estimates in (1) for B, yields an indeterminate form. B, may, however, 
be computed by assuming that the estimates are 1, a, 6, ...,a,_,6. Then it is possible to deter- 
mine B, as a limit as d> 0. Values of a,, ...,a,_, are obtained by maximizing the appropriate 
likelihood function. 

It turns out that the normal equations for a,,...,a,_, in the maximization process have 
already been solved in the computation for (¢—1) treatments and n repetitions. Further, 
the value of B, also occurs in that table. The procedure in this case is simply to obtain the 
reduced set of (¢— 1) sums of ranks, Zr,—2n,..., Zr,—2n, and to enter the table specified 
with this set of sums of ranks. The required value of B, is copied from that entry, and we 


ee 
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could also record the treatment parameter estimates as secondary estimates of the a’s for 
our new table. 

These notes can be illustrated. With t = 5, n = 5, consider the set of sums of ranks 20, 29, 
30, 32, 39. The table shows estimates 1,0,...,0 and B, = 5-858. The reduced set of sums of 
ranks is 19, 20, 22, 29. The table (in the 1952 paper) for ¢ = 4, = 5 contains this entry with 
estimates, 0-44, 0-34, 0-20, 0-02 and B, = 5-858. In the table for t = 5, n = 5, we could have 
shown the estimates as 1, (0-44), (0-34), (0-20), (0-02), the secondary estimates being in 
parentheses. The secondary estimates are of course equivalent to those that would be found 
if the data were analysed ignoring all comparisons involving the first treatment with the 
extreme sum of ranks. This only means that this first treatment is so ‘superior’ to the others 
that differences among the remaining treatments are overshadowed by its presence. 

Another extreme case of less consequence occurs when one of ¢ treatments obtains the 
maximum possible sum of ranks, 2n(t— 1). Then, again, a reduced set of sums of ranks may 
be obtained for the remaining (t—1) treatments. This reduced set is Xr,—n,..., 34-7, 
and the table for (t— 1) treatments e~1 » repetitions may be used to find ,,...,,, and B, 
directly. In this case p, has the value zero. 

These two kinds of extreme sets of sums of ranks indicate yet another use of the tables. 
In the special cases where extreme sets of sums of ranks occur, and where ¢ exceeds tabled 
values by unity, estimates p,,...,, and B, may be obtained with the help of the table for 
(¢— 1) treatments and n repetitions. The approximate test may then be used by computing 

— 2InA, given in (5). 


5. ERRATA IN PREVIOUS TABLES 
Only two errors have been noted in the tables published previously and these are both trivial. 
(1) In the table for ¢ = 4, n = 5, the value of B, recorded as 1-474 should be 2-173. The 
table entry then reads: 


eh Ve OE SRE ee eee ee 


This correction does not change the order of the recorded sets of sums of ranks. 
(2) In the table for t = 4, n = 5, the rows with B, = 7-884 and 7-895 should be inter- 
changed. The probabilities P must then be adjusted and these two rows should read: 


19, 22,...25, \a0; “47, :24, -19, ..-10; 7-884; -1909 
20, 20, 25, 25; “37, .°37,. -12,, ,-12; 7-895; -1964. 


The values for the mean and variance of — 2In A, given in Table 2 of the earlier paper for 
t = 4, n = 5 have been corrected and are recorded in Table 1 of this paper. The mean is 
corrected from 3-13 to 3-17 and the variance from 6-66 to 6-76. 


Funds for this computing project were provided by the Quartermaster Food and Con- 
tainer Institute for the Armed Forces. In addition to this assistance, the author would 
like to acknowledge the co-operation of Dr D. K. Tressler, Scientific Director of that 
Institute, and of K. R. Wood, D. R. Peryam and Miss Dorothy Johnson. The original paper 
on paired comparisons was prepared under Contract No. A-1s-32683 with the Bureau of 
Agricultural Economics. United States Department of Agriculture, and the continued 
interest of members of that Department and of M. E. Terry, who was co-author of that 
paper, is appreciated. 
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The computation of the tables could not have been completed without the direct assist- 
ance of quite a large number of people. The author is indebted to R. G. Cornell for super- 
vising much of the computing, to R. M. Abelson, who primarily assisted Mr Cornell, to 
A. F. Teske and Mrs Elizabeth Skinner, who made the facilities of the I.B.M. Tabulating 
Division available and provided assistance and helpful advice, and to C. Y. Kramer, 
R. E. Kirk, Miss Nancy Phillippi, Mrs Marianne Byrd, Mrs Ganelle Swartz, Mrs Willie 
8. Dickerson and Mrs Joan Ledwith for hand computations and clerical assistance. 
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TABLES FOR THE RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS 


APPENDIX. The distribution of the likelihood ratio for general alternatives 


The following table gives the values of the likelihood-ratio statistic, B,, and the likelihood 
estimates of the true treatment ratings, p,,...,,, together with probabilities, P, that B, 
will not be exceeded if the null hypothesis is true. Since low values of B, indicate discordant 
results, P gives the significance level. 

n is the number of repetitions of the design and ¢ the number of treatments. The design 
symbols, ¢ or v, A, b, r, k are standard and as used, for example, by Fisher & Yates (1953, 
p. 20, Introduction to Tables X VII-X VIII) and Cochran & Cox (1950, pp. 270 and 304). 
A in this design description should not be confused with the same symbol generally used to 
indicate a likelihood ratio. Parentheses contain combinations with equal values of B,. 
<r, is the sum of ranks for treatment i. 

In setting up the table, several conventions have been adopted to simplify the printing: 
(i) When p, is unity and the remaining estimators are therefore all zero, the result is given as 
1 — — — or 1 —.—-— —. (ii) The lowest value of B, possible for each n is zero and is 
as 0. (iii) When there are no entries in the final column above a single entry of -0000, the 
corresponding values of P are less than a half-unit in the fifth decimal place. 
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4 treatments. (Design: t = 4,A = 1,b = 6,r = 3, k = 2) 
Ir, Ur, Urs Urs] Py Pe Ps Mm B, if Zr, Ur, Urs Urg| Py Pe Ps Mm B, 
n=7 n=T (cont.) 
21 28 35 42/1 aa. mics aie 0 21 30 37 38/1 ce a = 
21 28 36 41/1 — ca 1 | 21 32 33 40/1 site: “aa con 
21 29 34 42/1 co. Se. 1-247 23 30 31 42| -75 -14 -ll1 — 
22 27 35 42] -86 -14 — be 25 26 33 42| -51 -41 -08 — 
22 29 34 41] -86 -10 03 — 4-600 
21 28 37 40/1 — — iss, | = 
21 30 33 42/1 atin, a ann 1-819 
23 26 35 42 ae, a oo hae 23 28 .37..39 86 -12 -0l =} 4-874 
21 28 38 39/1 a ee ee 24 26 35 41 ‘60 -36 -03 — 
Ans ea\t — ~— —} sen nlc: inactive | * pS ineccotliaaa ee 4-884 
94 25 35 42 a ae pele 24 28 32 42 ‘64 -26 -10 — 
22 28 38 38| -86 -12 -O1 “a ean 
23 27 36 41) 26-14 — — 2-494 25 25 35 41) -48 -48 03 — 
rs % Po ‘e ig 12-02 = — 
| 7 22 30 33 41] -87 -09 -04 — 5-027 
2 27 37 40] -86 -14 — — 
i eS ee } 3-066 oS Wl ow awe 
e 21 32 34 39/1 hee tm, eg s-ivs 
a a & ale 24 29 31 42| -64 -22 -14 — 
aes ae ae vantill SS ea 25 27 32 42| -54 -35 -12 — 
22 29 33 42| -86 -10 03 — 
23 27 34 42] -73 -24 03 — 23 27 36 40| -73 -24 -02 -O1 5-175 
22 27 38 39| -86 -14 — 7 3-393 22 31 32 41] -87 -07 -06 — 5-229 
24 25 36 41 67. 43 — — z 21 31 37 37/).1 ous rey 
21 33 33 39/1 ae wed aa 
21 29 37 39/1 =r nae ae 24 30 30 42] -65 -18 -18 — —_ 
21 31 33 41/1 RD BPs Er 3-561 26 26 32 42) -44 -44 -12 — 
22 30 32 42| -87 -08 05 — 
24 26 34 42| -60 -36 -03 — 
93 26 37 40| -71 29 — : 3-638 22 29 35 40 86 -10 -02 al 5-323 
23 28 34 41/| -74 -21 -05 -O1 
21 29 38 38/1 tags, et ag 23 27 37 39 73 -24 -02 ii} 5-521 
21 32 32 41/1 = Made dyno oan 24 26 36 40| -60 -36 -03 -Ol 3 
22 31 31 42| -87 07 07 — i: 21 32 36 38/1 — — = 5-544 
25 25 34 42 a ae ee 25 28 31 42 +55 -29 -16 -— 
22 28 35 41| -86 -12 01 — 3-878 
J 23 27 38 38] -73 -24 -O1 -01 
eS SS ee ee ear = 3-895 25 25 36 40| -48 -48 -03 pt 5-631 
2% 25 37 40| -57 48 — — 21 32 36 37/1 ca sdk aa 
> oe oe us tee fa 91 33 34 38|)1 — — = 
23 28 33 42| -74 -20 06 —J rs 25 29 30 42| +65 -25 -20 — 5-723 
% 2 38 30) 57 43 — — 4-152 96 27 31 42| -46 +37 +17 A 
21 30 36 39/1 =a 
21 31 34 40/1 tee i e 22 29 36 39| -87 -10 -02 -01 ' 
23 299 32 42| -75 -17 og —{| #372 24 27 34 41| -63 -31 -06 -o1f | *75! 
24 27 33 42] -62 -31 -07 — 22 30 34 40| -87 -09 -04 2 5-86 
22 28 36 40/| -86 -12 -01 .— iad 23-29 33 41] -75 -17 -07 -Ol 
23 27 35 41] -73 -24 -02 ry 24 26 37 39| -61 -36 -02 -0l 5-868 
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=r, , 








r 
Zr, Ur, Xry Try] Py Ps Ps Mo B, 4 Zrs Ure] Pi Po Ps Da B, FP | 
n=7 (cont.) n=T (cont.) | 
{ 
22 29 37 38] -87 -10 -02 -O1 22 31 36 37| -87 -08 -03 -02) | 
25 26 34 41| -52 -41 -07 a} 068 26 27 32 41| -46 -38 -14 -o1f | 7230 
24 26 38 38] -61 -36 -02 ps _— 25 26 37 38] -52 -41 -04 -03 7-294 
25 25 37 39] -48 -48 -02 -Ol 22 32 34 38| -87 -07 -04 on son 
21 33 35 37/1 ge } nee 25 29 31 41] -56 -25 -17 -O1, 
26 28 30 42] -47 -32 -21 — 
22 33 33 38] -87 -06 -06 pe | 7-360 
23 28 35 40] -74 -21 -04 -01 6-043 25 30 30 41] -56 -21 -21 -Ol 
21 33 36 36/1 anh’ om isle 23 29 36 38] -75 -18 -04 po 7a } 
21 34 34 37/1 LD | ciples sé 25 27 34 40] -54 -35 -09 -02 
26 29 29 42] -47 -26 -26 — 23 29 37 37} -75 -18 -04 pe o* 0-000 
27 27 30 42] -39 -39 -22 — 26 26 34 40] -44 -44 -09 -02 
25 25 38 38] -48 -48 -02 -02 6-088 23 30 34 39] -75 -15 -07 _ — = 
22 31 33 40] -87 -07 -05 2) *.ifo 24 29 33 40] -65 -23 -10 -02 
23 30 32 41] -75 -15 -10 -01 22 32 35 37] -88 -07 -04 Pe oe 
22 32 32 40] -87 -06 -06 rg ‘aes 26 28 31 41] -48 -32 -19 -O1 | 
23 31 31 41] -75 -12 -12 -O1 24 28 35 39] -64 -27 -07 -03 7-615 | -0001 
} 
21 34 35 36/1 in sey tl 22 32 36 36] -87 -07 -03 -03 
27 28 29 42] -40 -33 -27 ey oa 27 27 31 41| -40 -40 -19 ry 7 ™ 
21 35 35 35/1 a 22 33 34 37| -87 -06 -05 -03 , é 
28 28 28 42] -33 -33 -33 —f 6-338 26 29 30 41| -48 -27 -23 on al il 
22 30 35 39] -87 -09 -03 -Ol 23 31 33 39| -76 -13 -09 -03 
24 28 33 41/ -64 -26 -09 rf oe! 24 30 32 40| -65 -19 -13 ‘nat Ts Se 
23 28 36 39] -74 -21 -08 -02 23 32 32 39| -76 -11 -11 -03 ' 
24 27 35 40| -63 -31 -05 3} Cee 24 31 31 40| -66 -16 -16 ‘ad 1879,| oe 
22 30 36 38] -87 -09 -03 -02 22 33 35 36| -87 -06 -04 -03 
25 27 33 41| -54 -35 -10 as} 926 27 28 30 41| -41 -34 -24 a Tose) 
23 29 34 40] -75 -18 -06 -01 6-618 24 28 36 38| -64 -27 -06 -04 
25 27 35 39| -54 -35 -07 ter 7006): 
23 28 37 38] -74 -21 -03 _ ato 
25 26 35 40| -52 -41 -06 -02 23 30 35 38| -75 -15 -06 pe 7-006 | -osh 
22 31 34 39| -87 -08 -04 =) 6-003 25 28 33 40| -55 -30 -12 -02 
24 29 32 41| -65 -22 -12 -O1 22 34 34 36| -87 -05 -05 -031 | 79621 ooge 
22 30 37 37| -87 -09 -02 || eine 27 29 29 41| -41 -29 -29 -o2/ 
26 26 33 41] -44 -44 -10 -Ol 24 28 37 37| -64 -27 -05 = jose |: aa 
26 26 35 39| -45 -45 -08 -03 
22 32 33 39] -87 -06 -05 =) oilbs 
24 30 31 41] -65 -19 -15 -O1 22 34 35 35| -87 -05 -04 =) coes |: aa 
24 27 36 39] -63 -31 -04 -02 6-893 28 28 29 41| +35 -35 -29 -02 
23 30 33 40] -75 -15 -08 -02 6-976 23 30 36 37] -75 +15 05 041 | ong] oogs 
22 31 35 38] -87 -08 -04 = olies 26 27 33 40| -47 -38 -12 -03/ 
25 28 32 41| -55 -30 -14 -O1 24 29 34 39| -65 -23 -09 -03 8-117 | -0002 
24 27 37 38] -63 -31 -04 $} 7404 25 27 36 38| -54 -36 -06 -04 8-174 | -0002 
25 26 36 39] -52 -41 -05 -02 23 31 34 38| -76 -13 -08 =) e-2s01 call 
23 29 35 39] -75 -18 -05 =) cane 25 29 32 40| -56 -26 -15 -03 
24 28 34 40] -64 -26 -08 -02 25 27 37 37| -54 -36 -05 | 8-265 | -oogt 
23 31 32 40] -75 -13 -10 -02 7-149 26 26 36 38| -45 -45 -06 -04 
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ir, =ry| Py PP, Ps Me B, P Ur, Zr, Urs Bry] Pi Po Ps Me B, P 
n=T (cont.) n=T (cont.) 
26 26 37 37| 45 -45 -05 -05 | 8:355| -0003] 24 32 33 37| -66 -15 -13 -06)| 9.15] coos, 
23 32 33 38| -76 -1l -09 i 3-386 | -o003 | 26 30 31 39| -50 -25 -21 -05 
25 30 31 40| -57 -22 -18 -03 24 31 35 36) -66 -17 -09 -07)| 9.66 | ooae 
24 30 33 39| -66 -20 -11 -03 | 8-436| -0003|27 28 32 39| -42 -35 -18 -05 
24 29 35 38| -65 -23 -08 -04) | 242 | ooog | 25 30 33 38| -57 -23 -14 -06 | 9-576] -0040 
25 28 34 39| -56 -31 -10 -04 
25 29 36 36| -57 +27 -08 -08 
23 31 35 37| -76 -13 -07 -04) | 240. | goog | 27 27 34 38] -41 -41 -12 po | POF nce 
2% 28 32 40| -48 -33 -16 -03 25 31 32 38| -58 -20 -17 -06 | 9-720! -0046 
23 31 36 36| -76 -13 -05 -05)| 9.551 ooos | 26 28 35 37] -49 -34 -10 -07 | 9-763| -0050 
27 27 32 40| -40 -40 -16 -03 24 32 34 36] -66 “15 -11 -08) | 92041 oosy 
24 31 32 39| -66 -17 -14 -04 | 8-501| -0005}27 29 31 39| -43 -30 -22 -05 . 
24 29 36 37| -65 -23 -06 -05 26 28 36 36] -49 -34 -09 -09 
26 27 34 39| -47 -39 -11 ea) 8-641 | -0005 | 97 97 35 37} -41 -41 “11 4, ie oad Pam 2 
93 32 34 37| -76 -11 -08 -05 24 33 33 36] -66 -13 -13 -08 
26 29 31 40| -49 -28 -20 pod 8-708 | -0006 | 57 30 30 39] -43 -26 -26 et Por tes ae 
23 33 33 37| -76 -10 -10 -05 24 32 35 35] -67 -15 -09 -09 
26 30 30 40| -49 -24 -24 ‘03} 8-784 | -0007 | 52 28 31 39] -36 -36 -22 os} Per lus a. 
25 28 35 38| -56 -31 -09 -05 | 8815| -0007]25 30 34 37| -58 -23 -12 -07\| oeer| oozs 
24 30 34 38| -66 -20 -10 *s) 3-860 | -o00g | 26 29 33 38] -50 -29 -15 -06 
25 29 33 39| -57 -26 -13 -04 27 27 36 36] -41 -41 -09 -09 | 9-920] -0079 
23 32 35 36| -76 -12 -07 -06 24 33 34 35| -67 -13 -11 -09 
27 28 31 40| -42 -35 -21 a 8:865 | -0009 | 53 29 30 39] -37 -31 -27 a} iad ary 
25 28 36 37| -86 -31 -07 -06 25 30 35 36| -58 -23 -10 -09 
26 27 35 38| -47 -39 -09 a 8-991 | -0011| 57 98 33 38| -42 -36 -16 a herd Pies 
23 33 34 36! -76 -10 -08 -06 24 34 34 34] -67 -11 “ll -1l 
27 29 30 40| -42 -30 -25 a 9015 | 0012 | 59 29 29 39| -32 -32 -32 ‘) ie. ees 
24 31 33 38| -66 -17 -12 -05)| . 25 31 33 37| -58 -20 -15 -07) |... 
25 30 32 39| -57 -23 -16 ‘oa 9-087 | 0014 | 56 30 32 38| -50 -25 -18 -oef | 1100) “Ol19 
23 33 35 35] -76 -10 -07 -07)| . 25 32 32 37| -58 -17 -17 -07 
28 28 30 40| -36 -36 -25 -o3f | 7%!) O15) 56 3) 3) 38] -50 -22 -22 i} aired |S 
24 30 35 37) -66 -20 -08 = 9-105 | 0017 | 26 29 34 37| -50 -29 -13 -08 | 10-195] -0136 
26 28 33 39| -48 -33 -14 -04 25 31 34 36| -58 -20 -13 - sofeli seen 
26 27 36 37| -47 -39 -08 -06 | 9-160| -0017| 27 29 32 38| -43 -31 -19 -07 
24 32 32 38| -66 -14 -14 -05 hae 26 29 35 36] -50 -30 -11 -09 ; y 
25 31 31 39| -57 -19 -19 hn heione 0018 | 57 98 34 37| -43 -36 -14 ia} edad Hikieod 
23 34 34 35| -76 -08 -08 -07 25 31 35 35] -58 -20 ‘ll -1l 
28 29 29 40| -36 -30 -30 pel 9165) 0019) 53 98 32 38| -37 -37 -19 i} odart \ehieed 
24 30 36 36| -66 -20 -07 -07 25 32 33 36| -58 -18°-15 -09 
;' 0225 
27 27 33 39| -41 -41 -14 oa 9-185 | -0021 | 57 30 31 38| -44 -27 -23 pid nO-480 Jose 
25 29 34 38| -57 -27 -11 -05 | 9-280| -0022| 26 30 33 37| -50 -26 -16 -08 | 10-475] -0240 
24 31 34 37| -66 -17 -10 -06) | 0409) .oo95 | 27 28 35.36] -43 -36 -12 -10 | 10-496] -0256 
26 29 32 39| -49 -29 -17 -05 25 32 34 35| -58 -18 -13 a RS ee 
25 29 35 37| -57 -27 -10 -07\| o.559| .ooog| 28. 29 31 38| -38 -32 -23 -07 
26 28 34 38| -49 -34 -12 -06f 26 31 32 37| -51 -22 -19 -08 | 10-612| -0317 
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ir, Ur, &ry Urs] Pr Pe Ps Ms B, P Zyr Ur, Ur, Bry] Pi Po Ps Me B, P : 
=7 (cont.) n=7 (cont.) 

25 33 33 35| -69 -15 -15 ay 10-670 | -0341 | 29 29 34 34| -34 -34 -16 -16 | 11-850 cal 
28 30 30 38| -38 -27 -27 -07 28 31 33 34| -40 -25 -19 4) 1-077 |<ceT 
26 30 34 36| -51 -26 -14 ») 10-693 | -0390 | 29 30 32 35| -34 -30 -22 -14 
27 29 33 °37| -44 -31 -17 -08 28 32 32 34| -40 -22 -22 4, i8-081.| eal 
25 33 34 34) -59 +15 -13 +13) | 19.245] 9477 | 29 31 31 35| -85 -26 -26 -14 
29 29 30 38| -32 -32 -28 ‘a 
28 32 B3 33| -40 -22 -19 » } 
12-105 | -5138 
26 30 35 35| -51 -26 -12 -12) P. 30 30 31 35] -30 -30 -26 -14 
28 28 33 37| -37 -37 -17 -o9f | 1785 | 0445) 99 30 33 34] -35 * “ VW see cual 
26 31 33 36] -51 -22 -16 -10 29 31 32 34] -35 -26 - 17 i 
27 30 32 37| -44 -27 -20 a rie Soul i ¢ sos Sis: Ges On 
27 29 34 36/ -44 -31 -14 -10 | 10-910} -0560| 29 31 33 33) -35 -26 -19 - \ 
30 30 32 34] -30 -30 -23 -17f | 17298) °7028 
29 32 32 33| -85 -23 -23 -20 
26 32 32 36| -51 -19 -19 -10 ; 
27 31 31 37| -44 in 23 oo} 10-964 | -0603 | 30 31 31 34) -30 -26 -26 aus 19) | 
‘ d i i ' 
pa ~ . . ~ > in + 10-981 | -0648] 30 30 33 33| -30 -30 -20 -20 | 12-362| -8093 
oe..31) 34, 25 | (St “3 Ae 30 31 32 33] -31 -27 -23 -20 | 12-487/ -9210/| 
11-037 | -0750] 31 31 31 33| -27 -27 -27 -20) 
28 29 32 37| -38 -32 -20 ion} 9635 | 
30 32 32 32| -31 -23 -23 -23f | '7550| -9685)) 
32| +27 -27 -23 -23 | 12-612 | 1-0000 
28 28 35 35| -38 -38 -12 -12 | 11-052| -o763|°! *! 3 ss \ 
26 32 33 35] -51 -20 -17 -12) A babe a 
28 30 31 37| -39 -28 -24 -ogf | 1171 | -0898 n=8 } 
27 30 33 36| -44 -27 -17 -11 | 11-179| -0966 
26 32 34 34| -51 -20 -14 -14) | 
11-239 | -1044]24 32 40 48/1 — — — 0 
29 29 31 37] -33 -33 -24 -09/ 04 32 41 47/1 —=— =) 4 
26 33 33 34| -52 -17 -17 -15 mabe 4 beatae | 1809 
3 Pe. A AY . ; 25 31 40 48| 88 -12 — — t 
29 30 30 37| -33 -29 -29 00} any + betes ; | 
1098) 9ni.98| (48 ae Iw 8) |e |e ake BAP bo oe om oy 
rd fe F ; : 11-318 | -1409 | 24 34 38 48/1 —_- — — 1-954 t 
28 29 33 36| -38 -33 -18 i} 26 30 40 48| -75 -25 — —| | 
. - <- 35| -39 -33 -15 -13 | 11-456| -1532]o4 39 43 45/1 — — — | 
7 33 35 | -45 -24 +18 -13) 24 35 37 48/1 —-=— = 2-298 
; 11-515 | -1813 
= 2 7 > ‘39-29 -21 -11f 27 29 40 48| 62 38 — — 
82 35| -45 -21 -21 -13) s 
Sense WS ie | ie alee —| 
24 36 36 48/1 — — | 2-408 | 
27 31 34 34| -45 -24 -15 -15 he - 28 28 40 48| -50 50 — — 
29 29 32 36| -34 -34 -21 if eee |p eee 
27 32 33 34| -45 -21 -18 -16 , . 26°31 41 47/| 68 "12 — — 2-618 | 
29 30 31 36| -34 -29 -25 at S1T8D | | 2088 
28 30 33 35| -39 -29 -18 -14 11-717 | +2778] 24 33 40 47/1 tos ta tn 2-678 
25 32 39 48/ -88 -11 -O1 ~ 
27 33 33 33| -45 -18 -18 -18 
30 30 30 36/ -29 -29 -29 a 11-778 | -28601 55 33 39 47| -88 -09 02 — 3-220 
28 30 34 34| -39 -29 -16 -16) 
29 29 33 35| -34 -34 -19 -14f | 11784) °3108) 46 30 4) 47| -75 25 — r=) » oi 
28 31 32 35| -40 -25 -22 -14 | 11-846/ -3392]25 31 42 46/ -88 -12 — — 
} 
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Ir, Ur, Urs Uy) Pi Pa Ps M B, ir, Xr, org Bry] Pr Pa Ps Pa B, 
n= 8 (cont.) n= 8 (cont). 
24 33 41 46/1 — — — | 24 35 40 45/1. — — — bske 
2a 34 39 47/1 = — — wn 27 32 37 48| -67 -24 -09 — 
25 33 38 48| -88 -09 -03 — 25 34 38 47| -88 -08 -03 — 5-308 
26 31 39 48| -76 -22 02 — 25 32 43 44| -88 -1l -Ol } 3296 
28 29 40 47| -54 -43 -03 — 
25 31 43 45| -88 -12 — ~ 3-608 | 
27 29 41 47| -62 38 — — 26 31 41 46| -76 -22 02 — 5-466 
| 2435 414441 — — — 
25 31 44 44| -88 -12 — Ha 24 36 39 45/1 SMe Cabs 
3-717 2 . 
28 28 41 47| -50 -50 — — | 27 33 36 48| 8 -21 -11 —{| 97 
| 28 31 37 48| -58 -32 -10 — 
24 33 42 45/1 — — — 
4 35 38 47;/1 — — —'\1 3810 25 35 37 47| -88 -07 -05 — | 5-583 
25 34 37 48| -88 -08 04 — e583 40°46 | “as “to 42 $8} naad 
27 30 39 48| -6f -32 03 — ¢6 32°90°47| -27 49 Oe — 
25 36 36 47| -88 06 06 — 5-672 
26 30 42 46| -75 -25 — — 3-908 
= ee eT er ee 24 35 42 43/1 —-—--— 
ay ts tas ‘an | oboe cae col (NER a ee ee ee 
P ai 27 34 35 48| -68 -17 -14 — 
BS 80 180 598 | 86 88 ca} 08 5 29 30 37°48| -49 -45 -10 —) | 
25 32.40 47| -88 -ll -01 — 4-047 
wuwult —— | uel [BRE S| ST S| om 
26 32 38 48| -77 -19 04 — ots aE 
“75 - nll es Pe y 
ee mete 5 ie i 7) 4-252 28 32 36 48| -59 -28 -13 bade ae | 
26 30 44 44| -75 25 — — 
98 28 42 46| -50 50 — .) 4-362 28 29 41 46| -54 -43 -02 #) 
26 31 43 44| -76 -22 -O1 -Ol 
, 6-084 
27 29 43 45 42 28. <=. <= 4597 ya 33 41 45 “88 10 -02 -Ol 
ae Se Sale| ee 
24 35 39 46/1 — — — GT A698 | 
96 33 37 48| -77 -16 -o7 —{ | *66 25 34 39 46| -88 -08 -03 a haan 
27 31 38 48] -66 -28 -06 — 
24 36 41 43/1 to Se. Oee 
27 29 44 44| 62 -38 — — 24 37 39 44/1 to tte Ob 6-236 | 
A | 
m as 19 | “a0 sp — —)| 47 ooc31 yescas | 201 2esmecurh [| 
i . Ee wes +f “ 4 va 
ha r= Bs MEL Fag } 4:757 27 30 42 45| -65 -32 -01 -01 | 6-305 
25 32 41 46| -88 -1l O01 — | 
28 28 44 44| -50 560 — — 4-816 
as 42a2\t — — — | 
24 34 42 44/1 a0. oe +4 24 38 38 44/1 — + > 6-316 | 
24 36 38 46) 1 = ie <r pre 28 34 34 48| -60 » 20 — | 
26 34 36 48| -78 -13 09 — 30 30 36 48| -43 -43 -14 — 
28 30 38 48| -56 -37 06 — 28 30 39 47| -56 -37 -06 -01) ens 
25 33 42 44| -88 -09 -O1 -O1f 
24 34 43 43/1 oA. ose ' 
24 37 37 46/1 oe = 086 26 32 40 46| -78 -18 -04 -O1 | 6-374 
26 35 35 48| -78 -1l -ll — 29 29 39 47| -47 -47 -06 *) ests 
29 29 38 48| -47 -47 07 — 25 33 43 43| -88 -09 -O01 -0l 
25 32 42 45| -88 -11 -01 —)\| 2 ia0 25 35 38 46| -88 -07 -04 “4 cise 
27 30 40 47| -65 -32 03 —J 26 34 37 47/| -78 -14 -08 -Ol 
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Rank analysis of incomplete block designs 








Zr, Ur, Urs Ur, 


B, 








—a—e— eee 
oe ee 


—— ee eee ame ee See” eee 











7-052 


7-120 


7136 


7-152 


7218 


7°220 


7-225 
7-341 


7:°357 
7-396 
7-435 














7-535 
7-538 
7-615 
7-632 
7:704 
7-709 
7-773 
7-841 


7-851 


7882 
7-888 
7:977 


7-990 
8-012 


8-048 


8-066 
8-088 


8-149 


8-299 


8-315 


8-367 


8-423 
8-430 


8-439 








ne aa Ab oe 2 4a 











2) 









































Rap ALLAN BRADLEY 515 
) |r, Zr, Irs ory] Pr Ps Ps Me B, P Zr, Ur, Irs =r, Pi Ps Ps M% B, P 
n=8 (cont.) n=8 (cont.) 
27 35 36 46| -69 -16 -13 -02 27 34 39 44| -69 -19 -09 -04 
26 36 37 45| -78 -11 -09 -o2f | *462 28 33 38 45| -60 -25 -11 ies) Oo 1S 
25 37 40 42| -89 -06 -03 -02 26 37 38 43| -78 -10 -08 -04 
30 32 35 47| -46 -33 -20 a} ons 29 34 35 46| -54 -24 -20 -o2f | 9510) -0001 
27 32 42 43| -68 -25 -04 -03 26 36 40 42| -78 -11 -06 -04 
29 30 40 45| -49 -41 -07 = ened 30 32 36 46| -46 -33 -18 03} eed Pipers 
27 33 39 45/ -68 -22 -08 -02 | 8-624 26 36 41 41| -78 -11 -05 a} 9-658 | -0001 
31 31 35 47] -39 -39 -20 a ae 31 31 36 46| -40 -40 -18 -03 
25 37 41 41] -89 -06 -03 -03 29 31 40 44| -51 -36 -08 -04) | 966.1 ooo) 
26 34 41 43] -78 -15 -04 -03) | 2 4.4 28 32 41 43| -60 -29 -07 -05 
29 31 38 46] -51 -36 -11 -02 28 34 37 45| -61 -22 -14 -03) | 923.1 ooo) 
27 35 38 44| -69 -17 -10 -04 
30 33 34 47| -46 -28 -24 -01)| 20, 
25 38 39 42] -89 -05 -04 -03 28 32 42 42 60 -29 -06 a} 9-745 | -0001 
96 34 42 42| -78 -15 -04 -04 9-796 30 30 40 44 44 -44 -09 -04 
30 30 38 46] -48 -48 -11 -02 . 29 32 38 45 53 -32 -12 A 9-758 | -0001 
28 31 41 44| -58 -33 -06 -03 8-771 ~ - ne * 69 = i 04 
7 42| -78 -10 -07 -04 
26 35 39 44| -78 -13 -06 -03)| , 10, 30 33 35 46| -47 -29 -21 -o3f | *790) “0001 
~s 2 elie em a a} 26 38 38 42| -78 -08 -08 -05' 
25 38 40 41| -89 -05 -04 -03 d , i 
$1 32 34 47| -40 -34 -25 at 8-869 30 34 34 46| -47 -25 -25 -o3f | 9857) 0001 
28 31 42 43| -58 -33 -05 -04 27 36 37 44) -60 -14 -12 -04 y ; 
29 30 41 44] -50 -41 -06 -osf | %936 28 35 36 45| -61 -19 -16 -o3f | *870| -0002 
29 31 41 43| -52 -36 -07 -05 | 9-901| -0002 
25 39 39 41| -89 -04 -04 -03 
31 33 33 47| -40 -$9 -29 ay 8-938 30 31 38 45 45 -38 -13 ss} 9-904 | -0002 
27 34 38 45| -69 ‘19 -10 -03 | 8-989 27 34 41 42) “69 19 -06 -05 
28 34 36 46| -61 -22 -16 ned 9-004 31 32 35 46| -41 -35 -22 = 9-998 | -0002 
26 37 40 41| -79 -10 -06 -05 
32 32 33 47| -36 -35 -30 =) 
9-007 29 31 42 42| -52 -36 -06 -06 
coe 2 2 oe 30 30 41 43| -44 -44 -07 5} Oe le Te 
savant dm ant fae i i s} 9-031 30 30 42 42| -44 -44 -06 -06 | 10-053| -0002 
28 35 35 46| “61 -18 -18 -02 ee oF 81 es a el eee fone 
‘ 9-075 31 33 34 46| -41 -30 -26 -03 " ' 
26 37 37 44| -78 -09 -09 -03 
29 32 37 46| -52 -31 -14 -02 2 a oe oe ae os} 10-097 | -0003 
= a ab aol Ge ts bea 9-093 27 35 39 43! -69 -17 -09 -05 
2 30 42 43 | 60 41 05 04 | 9100 28 38 40 40| -70 09 08 08) | 15107) 0999 
27 35 37 45| -69 -16 -12 -03 | 9-202 
26 39 39 40| -79 -07 -07 -06 
30 31 37 46] -45 -38 -14 -02 Bo WIA Th oe a} ot 
} 9-241 
26 35 41 42) -78 -13 -05 -04 28 33 40 43 61 -26 -09 = 10-381 | -0008 
27 33 41 43) -68 -22 -06 an 9-265 299 32 39 44 53 -32 -ll -05 
- = - > - a ee be tate 28 34 38 44| -61 -22 -12 -04 | 10-261] -0003 
‘69 -14 +14 - 27 36 38 43| -69 -15 -11 -05 
pg pie rd 29 34 36 45| -54 -24 -18 oe MOEN |: ORNs 
27.33 42 42| -68 -22 -05 as} 9-342 | -0000| 59 32 37 45| -47 -34 -16 ~ oe es 
29 33 36 46| -53 -27 -17 -02) | 9.2,4| o99)| 27 35 40 42) -69 -17 -08 -06 
26 36 39 43 ‘78 -ll -07 -04 27 37 37 43 70 -13 -13 7 10-361 0004 
28 32 40 44/| -60 -29 -08 -04 | 9-436] -0001|29 35 35 45| -54 -21 -21 -04 











Rank analysis of incomplete block designs 








P2 Ps 


B, 


& 


mr, Ur, Ir, Ir, 


Po Ps PDP 


B, 





n= 8 (cont.) 


n= 8 (cont.) 




















10-366 
10-378 
10-458 
10-516 
10-570 


10-619 


10-660 


| 10-699 


10-704 


10-723 
10-804 


10-828 


10-877 


10-896 


10-897 


10-960 


10-962 
10-976 


11-004 


11-089 


11-147 


11-152 


11-182 


11-250 





0005 
-0005 
-0005 
0005 
0006 


-0007 


-0008 


“0008 


‘0009 


‘0009 
“0010 


‘0011 


‘0012 


0013 


0014 


0015 


0016 
-0016 


0018 


“0020 


“0022 


0023 


0025 


-0026 











11-280 
11-291 
11-335 


11-387 


11-397 


11-455 


11-478 
11-523 


11-529 
11-540 
11-559 
11-594 


11-652 


11-690 


11-778 


11-805 
11-825 
11-839 


11-901 


11-926 


11-955 


11-996 


12-059 
12-085 


12-128 
12-177 | 


12-236 

















wowwwow wo 





























Rape ALLAN BRADLEY 517 
Zr, Ur, Urs rr, | Pi P2 Ps Ms B, $" ir, Ur, Urs Ure] Pi Po Ps M% B, | - 
| 
n= 8 (cont.) n= 8 (cont.) 
29 36 39 40| -56 -20 -13 -1l 31 35 38 40| -44 -26 -17 -13 
32 33 36 43/ -38 -33 -22 aa} 12-300 | -0218 | 55 34 37 41| -39 -30 -20 pv 13-164) -1817 
30 35 37 42| -49 -24 -18 -09 | 12-307| -0231]33 33 37 41| -34 -34 -20 = sihie l. aheae 
31 33 38 42] -43 -32 -16 09 12-318 | -0957 | 31 35 39 39| -44 -26 -15 -16 
30 34 39 41] -49 -27 -14 -10 31 36 37 40| -44 -23 -20 -13) | 15565] 1698 
32 35 36 41| -39 -26 -23 ‘sh 
0 36 36 42| -49 -21 -21 -09 | 12-367| -0264 
12-381 | -0279 45-23 - 5 ; 
32 32 38 42| -37 -37 -16 09} 4 “4 vn re * = = pa 13-384 | -1981 
29 37 38 40| -56 -17 -15 -12) 
? 12-419 | -0312 ‘ i ge 
32 34 35 43] -38 -29 -25 -08/ ~ = n= = = = eo 13-390 | -2111 
33 33 35 43 33 -33 -25 -08 . pe 31 37 37 39 -45 -20 -20 -15 
29 37 39 39 56 -18 -13 is} 13860 0331 33 35 35 41! -35 -27 -27 iat 13-440 | +2257 
31 33 39 41 43 -32 -14 -1l 12-507 0350 | 34 34 35 41 ‘31 -31 -27 -12 13-408 eacs 
29 38 38 39 56 -15 -15 4 12-539 037] | 31 37 38 38 -45 -20 -18 -18 
33 34 34 43) -34 +29 -29 -08 32 35 37 40| -39 -26 -20 -14 | 13-501| -2588 
30 35 38 41 a Sa AB 4) 32 36 36 40; -40 -23 -23 -14 13-557 | -2681 
$1 34 37 42| -43 -28 -19 oo} 12-555 | -0415/ 39 35 38 39| -40 -27 -18 -16 
31 33 40 40 43 -32 -12 -12 “ _| 33 34 37 40] +35 -31 -21 -14 paar elt 
32 32 39 41| -37 -37 -14 i} 12669) 0437 | 32 36 37 39| -40 -24 -21 iat 13-728 | -3648 
32 32 40 40/ +38 -38 -12 -12 | 12-632| -0444]33 35 36 40/ -35 -27 -24 -14 
33 34 38 39| -35 -31 -18 -16 | 13-731] -3920 
30 36 37 41| -50 -21 -19 -11 
, 32 36 38 38| -40 -24 -18 -18 
31 35 36 42| -44 -25 -22 oat ce iad a is ate GS 13-785 | -4226 
32 33 37 42| -38 -33 -19 -09 
’ é 32 37 37 38| -40 -21 -21 -18 
30 35 39 40| -49 -24 -14 a} Sct Bes bog Oh Re ae po 13-840 | -4571 
33 33 39 39| -34 -34 -16 -16 | 12-683] -0593 
33 35 37 39| -35 -27 -21 -16 | 13-898] -4962 
31 34 38 41| -44 -29 -17 -11 | 12-801 | -0630| 33 36 36 39| -35 -24 -24 -16 | 13-954] -5182 
30 36 38 40| -50 -21 -16 -12 34 34 37 39| -31 -31 -21 -16 
32 34 36 42] -39 -29 -22 toh 12853 | -0713 | 33 35 38 38| -35 -27 -19 Dt erie erie 
32 35 35 42| -39 -26 -26 -10 34 34 38 38| -31 -31 -19 -19 | 14-011! -5747 
30 37 37 40| -50 -19 -19 fa ee ee 
31 36 36 41| -44 -22 -22 -11 | 14-038] -5777 
| .86 -94 -9] - 
30 36 39 39| -50 -21 -14 -14 Be hy Seether be Fa 
12-912 | -0806| 34 35 36 39| -31 -28 -24 -17 
33 33 36 42| -34 -34 -23 -10 on ss Seat at ae 
ad | ie ‘iy | 12922 | 0902] 33 37 37 37/ -36 -21 -21 igi} | #120] -7107 
st 35 37 a1 | 46-2 DT {| ieere) Ses] Fe MS Pe ee 
34 36 36 38| -32 -25 -25 -19 | 14-231] -8220 
33 34 35 42| -34 -30 -26 -10) | 35 35 36 38| -28 -28 -26 -19) 
30 37 38 39| -50 -19 -17 is} | 13-028 | 1076] 54 36 37 37| -32 -25 -22 -22} | 14286) “9122 
32 33 39 40! -38 -33 -15 -13 | 13-043| -1137]35 35 37 $7| -28 -28 -22 -22 | 14-340] -9375 
30 38 38 38| -50 -17 :17 7 13-086 | -1160 | 35 36 36 37| -28 -25 -25 -22 | 14-368] -9946 
: 36 36 36 36) -25 -25 -25 -25 | 14-450] 1-0000 
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Rank analysis of incomplete block designs 






























































5 treatments. (Design: t = 5,A=1,b=10,r = 4, k = 2) 
Zr, Ur, Xr, Ur, Irs Ps Ps B, P ir, Ir, Ur, Ur, Xr; B, 
n=1 
4567 a. 0 1172 12 12 12 4149 
4577 ae = 10 12 18 
4 6 6 6 a -903 | -2344 il 14 4-219 
5 & & 7 33-33 ll 13 
“ ~ 4-436 
4667 SS 2 
5 5 6 6 38 -12 1-579} -4688 10 12 14 4-471 
5 5 6 7 “88 +14 2-235 | +7081 1 12 aliina 
5 6 6 6 AT +17 2-640} -9766 12 12 13 
6 6 6 6 -20 +20 3-010 | 1-0000 10 13 pond 
4 
n=2 
12 13 
il 12 4-848 
8 10 12 14 ar ae ae | .000| -0001 il 13 5-049 
8 12 15 1 — an 12 12 5-280 
8 10 13 13 coi a obi 11 13 
8 ll ll 14 ai 2 602| -0006 1 13 5-288 
9 12 14 50 +50 — 
12 13 
8 11 11 15 a. 2k 11 12 12 rane 
9 12 15 io — 1-204 -0009 ll 13 5-665 
9 13 13 i — 12 12 5-844 
8 10 13 14 a 12 12 6-021 
8 12 13 ee } 1-498| -0030 
9 ll 14 28 +13 
14 14 ab 
12 12 ity ke 1-806| -0035 15 18 21 1 —lo 
10 14 83-33 15 18 22 1 z | 
13 14 <4 15 19 20 1 _} 
ll 15 28 +13 } S90] SOFT as 16°17 ‘21 1 = Ow 
14 18 21 a 
12 14 i ie 
ed Sa 2-359| -0090 1 22 =} . 
14 14 50 — — | 1-659 
1 10 15 33 -33 4-408} -0008 14 20 —_— 
13 13 bs ies at 15 19 21 = 
ll 13 17-17 } nog! ba 16 18 20 — {| 1-840 
15 17 21 _ 
> fe a 15 22 1 — 
2-898| -0227 15 20 20 1 al 
12 12 18 +10 . “ ; 
ll 13 87-21 ~ St 2-077 
+4 p ae } 3-158] -0266 a “7 ‘ = 
12 12 88 +12 pon s 
12 14 29 -08 3-217| -0328 ane eens fi 
13 13 lly 17 19 2-511 
11 12 23 +23 3-380) -0444 a: dene “" 
13 13 29 -05 
x - 1 oni 
ll 14 17 +17 FES |, CO 6.98 2-670 
15 17 29 nl 
13 13 a. od 15 21 21 al 
ll 1 25 +25 3-612 | 0556 18 18 =} 2-709 
13 14 29 -05 15 15 21 ab 
11 14 37-21 $747) -0706) 19 16 18 21 —\| osse 
12 13 18 -1l 3-966 | -0926 15 18 20 = 


























ras 
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RaLpPH ALLAN BRADLEY 519 
ir, Ur, Xr, Ur, Urs] P. Ps Ps Me Ps B, P |r, Ur, Ury Ure Urs! Pi Ps Ps Me Ps B, P 
n= 3 (cont.) n=3 (cont.) 
13 14 19 22 22/ 67 33 — — — Hise eli = ee 
13 14 20 20 23| -67 -33 — — —\! , 406] oo9)] 15 15 18 18 24| -88 -38 -12 -12 —J| #797) “0017 
13 16 16 22 23| -71 -14 -14 — — 13 16 18 20 23| -72 -16 -07 -03 -01 | yoo] cooi9 
14 14 17 22 23] -45 -45 -09 — — 13 15 20 20 22] -71 -23 -03 -03 -01)| 4595] -oo90 
eee, of oe 14 16 16 21 23| -52 -22 -22 -02 -Ol 
Seem t. - . . a 
18 15 19 19 24| -71 -23 -03 03 — [| *°} “OO1) 14 a4 19 21 22] -46 -46 -05 -02 -01)| 4 a0 ooo) 
14 14 18 20 24| -48 -46 -06 02 — 14 15 17 22 22| -51 -32 -14 -O1 -O1 
13 16 19 19 23| -72 -17 -05 -05 -01)| , : 
OR Pees | ee 13 17 17 20°23| -73 -12 -12 -04 Pt et oe 
ao a i — 8-248} -0001/13 15 20 21 21) -71 -23 -03 -02 -02\| . 09] .ooos 
15 15 16 21 23| -36 -36 -24 -03 -01 
217 17 22 22/1 = — — — —)/ gan} coo 
14 14 19 19 24| -46 -46 -04 -04 — ‘a ee ee A ee 
o zs p 2 be Oy ae = a 3-340] -0001]15 16 17 18 24| -39 -28 -19 -14 —Jf| FOS) -0031 
14 14 20 20 22| -46 -46 -03 -03 -01)| J o561 gogo 
14 16 16 22 22| -52 -22 -22 -02 -02f 
13 14 21 21 21; -67 83 — — —)|, , wn 6281)... Soe 
15 15 15 22 23| -33 -33 -33 — a 3600) CORT is 30 06: MOLE ce ee cies! dee 
12 16 19 21 22; 1 --—--- 15 17 17 17 24] -40 -20 -20 -20 — 
Pawnee 2s > ie 16 16 16 18 24| -29 -29 -29 -l4 — 
13 16 18 19 24| -72 -16 -07 -05 = 5-650) 008 
14 15 17 20 24| -50 -32 -14 -03 — 14 15 18 20 23| -51 -33 -10 -05 -O1)| , . 
13 16 18 21 22| -72 -17 -07 -02 -o2f| *200) “0040 
13 15 18 21 23| -71 -23 -05 -01 — | 3-882} -0003| 14 14 20 21 21) -46 -46 -03 -02 -02)/ 55531 .oo4) 
12 16 20 20 22/1 ee aa 15 15 16 22 22 36 -36 -24 -02 -02 
thing o-~< 13 17 18 19 23| -73 -12 -08 -06 -01 | 5-299] -0044 
121719 19 23/1 — se pe 
13 17 17 19 24| -72 -11 -11 -05 — i es a ae 
4 16 16 20 24| -52 -22 -22 -03 — — ee Bice ; 
' wwtbp - sprelbcis 16 16 17 17 24| -29 -29 -21 -21 —Jf| *346) “0047 
13 17 17 21 22| -73 -12 -12 -03 -02)| d 
See = se 14 15 19 19 23| -51 -83 -07 -07 -o1f| 5368) -0050 
! 18 19 a. = — —) aoe ‘ 13 18 18 18 23| -73 -09 -09 -09 -01 | 5-456] -0051 
13 17 18 18 24| -73 -12 -08 -08 =| a 
15 15 16 20 24| -36 -36 -24 -04 — 14 16 17 20 23| -53 -24 -17 -05 -O1 s-see| 
eee ae 4 4-060! -0005| 13 16 19 20 22] -72 -17 -06 -04 -02 -— 
1415 18 19 24) -51 -33 -10 -06 — 14 15 18 21 22] -51 -33 -10 -03 -02 | 5-598] -0066 
13 16 19 21 21| -72 -17 -06 -03 -03 
5-695| -0072 
138 15 18 22 22| -71 -23 -05 -O1 " «065 | >-0008 15 15 17 20 23| -37 -37 -18 -06 -01 
Soo So ee 14 16 18 19 23| -53 -24 -12 -09 -O1 
13 16 17 21 23| -72 -16 -10 -02 -01)| ,q ‘53 +24 -12 -09 - : j 
Bune) 2B Ms el ote ee ele eee ee 
14 14 18 22 22| -46 -46 -07 -01 -01 | 4-298] -0006 ‘12 +17 +04 -04 - ; ‘ 
15 16 16 20 23| -38 -27 -27 -06 ai} | 
14 15 19 20 22| -51 -33 -08 -05 -02 
 aeree Sv ise. ee eS ee ; 14 16 17 21 22| -53 -24 -17 -04 -ogf| 5920) -Ol17 
14 16 17 19 24| -53 -24 -16 -07 —J| #397) “0008 
13 16 17 22 22| -72 -16 -10 -O01 -O1 ‘ “ 13 17 19.19 22] -73 -12 -06 -06 -02 
14 14 18°90 88} 46 -46 -05 -0p! ony] ‘*470| “OOO h TT Ce ee ee a 5-901 | 0138 
ee ee ee 13 17 18 21 21| -73 -12 -09 -03 +03)! goon! .orao 
12 18 18 20 22/1 — — — —\) 4gs6s] -0011]15 15 18 19 23| -38 -38 -13 -09 -02 
14 16 18 18 24| -53 -24 -11 -11 — 14 15 19 21 21| -51 -83 -08 -04 -04)| go oee| ors 
15 15 17 19 24 ‘37 -37 -18 -08 — 15 15 17 21 22 37-37 «-18 « «-04 os} 
13 15 19 21 22| -71 -23 -04 -02 -01)| , ' 14 17 18 18 23| -54 -18 -13 -13 = ask 
14 15 17 21 23| -51 -32 -14 -02 -o1f| * 648) “0013/43 4g 3g 19 22] -73 -o9 -09 -07 -o2f| %187) © 
9-27-2099 tj}? oe 15 16 16 21 22| -39 -27 -27 -05 = sein} eee 
12 18 19 19 2/1 — — — —|/ ,,,] 904] 14 15 20 20 21| -51 -34 -06 -06 -04 
1417 17 18 24| -54 -17 -17 «12 — 13 17 19 20 21| -73 -13 -06 -05 =} osea| cen 
15 16 16 19 24| -38 -27 -27 09 — 15 16 17°19 23| -40 -28 -20 -10 -02 
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Rank analysis of incomplete block designs 



































Ur, Ur, Ur, Ure Us| Pi Pe Ps Me Ps B, P Er, Ur, Ur, Ure Us| Pr Pa Ps Me Ps B, P 
n=3 (cont.) n= 3 (cont.) 
14.16 18 20 22| -53 -25 -13 -06 -03 | 6-378| -0250]15 17 18 19 21! -42 -22 -17 -12 -07 | 7-795) -2825 
13 18 18 20 21| -73 -09 -09 -05 -03)| 6 445| 997] 15 18 18 18 21| -42 -17 -17 -17 -07 | 7-921| -2902 
16 16 18 18 23| -40 -28 -15 -15 -02 15 17 18 20 20| -42 -22 -17 -09 *) sone | saan 
13.17 20 20 20/ --73 -13 -05 -05 -05\| 6 445| .oogg| 16 16 18 19 21) -31 -31 -17 -13 -07 
16 16 16 19 23| -29 -29 -29 -11 “02} 15 17 19 19 20/ -42 -23 -13 -13 -10)| 9 o56| son 
16 17 17 19 21| -82 -24 -24 -13 -07 
14 16 19 19 22| -54 -25 -09 -09 it 
6-523 | -0316 
= He = 7 * . + 2 * 16 16 18 20 20| -31 -31 -18 -10 -10 | 8-063) -4127 
“38 - ‘07 - 6-542| -0348|15 18 18 19 20| -43 -17 -17 -13 ae) | ; 
a tol te ae Sol cane oe ae as 16 17 18 18 21| +32 -24 -18 -18 -o7f| 9179) “4898 
12-09 -07 -07 - 
2 6-585 | -0383| 16 17 17 20 20| -32 -24 -24 -10 -10)| . 
15 17 17 18 23) -41 -21 -21 -15 ‘o2} 16 16 19 19 20| -32 -32 -13 -13 -10f| %189| °5290 
14 17 17 21 21| -54 -18 -18 -05 -05)| . | 
15 15 19 19 22| -38 +88 +10 -10 = 6-686 | -0404/ 17 17 17 18 21| -25 -25 -25 -19 ss 8-304| -5619 
16 15 18 21 21| -38 -38 +14 -05 -05 | 6-706| -0415] 15 18 19 19 19) -43 +18 +13 +13 +13 
16 16 17 18 23| -30 -30 -22 -16 “oa} 6-727| -04621 16 18 18 18 20) -33 -19 -19 -19 -11 | 8-555| -7169 
16 17 19 19 19| -83 -25 -14 14 -14)| oon | aang 
14 17 18 19 22| -55 -19 -14 -10 -03 | 6-804| -o514] 17 17 17 19 20) +25 +25 +25 “14 “11 
14 16 19 20 21| -54 -25 -10 -07 mo tal eae 
15 16 17 20 22! -40 -28 -20 -08 -04 16 18 18 19 19| -33 -19 -19 -14 1A on oe 
13 19 19 19 20'| -73 -07 -07 -07 -05)| 6455] ogg] 17 17 18 18 20) +25 -25 -19 -19 -11: 
16 17 17 17 23) -31 -22 -22 -22 -02 17 17 18 19 19| -26 -26 -19 -15 -15 | 8-809] -9409 
17 18 18 18 19| -26 -20 -20 -20 -15 | 8-914! -9965 
15 18 18 18 22| -55 -14 -14 -14 -04 | 6-941/ -0650| 18 18 18 18 18| -20 -20 -20 -20 -20 | 9-031 | 1-0000 
14 16 20 20 20| +54 -25 -07 -07 -07 
16 16 16 20 22| -29 -29 -29 -08 oat were; wee 
15 15 19 20 21| -38 -38 -10 -08 -05)| 2 n=4 
15 16 17 21 21! -40 -28 ‘21 -06 06} POPS | 0 OE 
15 16 18 19 22| -40 -29 -15 -11 -04 “ea Sati — — —, 12 
14 17 18 20 21| -55 -19 -14 -07 et P88 | 1008 oe.go eee eli.) — ~ — 
15 15 20 20 20) -38 -38 -08 -08 -08 “6218 Twit. oe oe ee 
16 16 16 21 21| -29 -29 -29 -06 ‘o6} F194 | 00881 1g 91 93 28 32/2 — — — —7| 9% 
14 17 19 19 21] +55 -19 -10 -10 -05)| 74,5! .19g)]17 19 24 28 32| -75 -25 — — — 
15 17 17 19 22| -41 -22 -22 -12 -04 
14 18 18 19 21| -65 +14 -14 +11 -06\| 75.5! 1039 = 4 a +5 Rs we ee Tr Te 
15 17 18 18 22| -42 -22 -16 -16 -04 tpinaans xii — = = Ly om 
14 17 19 20 20| -55 -19 -10 -08 -08 
7-379| -1399]16 92 22 28 32}/1 — — — — 
16 16 17 19 22| -31 -31 -22 -12 -04 usmsme 2. er 
15 16 18 20 21| -41 -29 -16 -08 -06 | 7-404| -1566])7 19 04 99 311 -75 25 _ _ =} 1-064 
14 18 18 20 20/ -55 -14 -14 -08 -08)| 7500) segg “Te witha © bl 
16 16 18 18 22| -31 -31 -17 -17 -04 
15 17 17 20 21| -41 -22 -22 -09 -06)| -..,| sg, 16 20 25 28 31]2 — — — — 
15 16 19 19 21| -41 -29 -12 -12 -06 16 21 24 27 32/1 — — — —}| 2-084 
14 18 19 19 20] +55 +15 -11 11 -08)| 7 45,| 555] 17 20 23 28 32] -77 -19 -04 — — ; 
16 17 17 18 22| -31 -23 -23 -17 os} 6 1) 0.90/23 — — —,;—; 
42 06° Hh ee 
15 16 19 20 20| -41 -29 -12 -09 -09 17 19 24 30 30| -75 -25 — — — 
16 16 17 20 21| -31 -31 -23 -09 ot 7-674 | -24361 17 19 96 26 32| -75 -25 — — —,| 728! 
17 17 17 17 22) -24 -24 -24 -24 -05)| 1 76,| o4g,] 18 18 24 29 31| -50 -5O — — — 
14 19 19 19 19| -56 -11 11 “11 -11 18 18 25 27 32| -50 50 — — — 
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P Ur, Ur, or, rg Us| Py Ps Ps Pa Ps B, P Er, Ur, org rg Urs} Pi Pa Ps Pa Ps B, P, 
—— | n=4 (cont.) n=4 (cont.) 
| 16. 29.98, 00. 901-210. a se we +4 17 19 26 28 30| -75 -25 — — —\| go, 
+2825 18 18 24 30 30| 50 50 — — =} 2-408 18 20 22 29 31| -59 -28 -13 — — 
2902 18 18 26 26 32) -50 50 — — — 17 19 26 29 29) -75 2 — — — 
3371 16/90/26 30 90) 200. ae ae oe Ly 17 19 27 27 30| -75 -25 — — —|| 41, 
| oR i ate) ee ee 18 21 21 29 31| -60 -20 20 — — 
- 6 Ste ett — —"—rig 19 19 22 29 31| -43 43 -14 — — 
— 16 22 23 27 32/1 — — — —f| 7468 
) |17 21 22 28 32] -78 -13 09 — — 18 18 26 28 30| -50 50 — — —\| gon, 
4127 18 19 23 28 32| -56 -37 06 — — 18 20 22 30 30| -59 -28 -13 — — 
' 16° 91°98 @iso;r (SS te ee 
4008 16 20 26 28 30/1 — — — — 16 22 2 27 31/1 — — — —\l gon 
16 38 94:26 $8) 100 so we ma =} 2-997 17 21 24 26 32| -78 -14 -05 02 — 
"5290 18 20 22 28 32| -69 -28 -13 — — 18 20 23 27 32| -60 -28 -10 -02 — 
17 19 25 28 31| -75 -25 — — i 5 oli 
17 20 23 29 31| -77 -19 04 — — 17 20 24 28 31| -77 +19 -03 -O1 — | 4-284 
5619| | 18 18 26 29 29| 50 50 — — — 
16 20: 98° 96 90/1 - — — —' 18 18 27 27 30| 50 50 — — — 
at 16 20 27 27 30/1 — — — — 18 21 21 30 30| -60 -20 20 — —y,| #36 
16 22 25 25 32/1 — — — —|j gine 19 19 22 30 30| -43 -43 -14 — — 
7713 16 23 23 2% 32/1 — — — — 
18 21 21 28 32] -60 -20 20 — — 16 21 25.90 99/ho = & mw Lb 
19 19 22 28 32| -43 -43 -l4 — — 16 23 23 27 31}1 — — — —\} gg, 
8749 17 21 25 25 32| -78 -15 -04 -04 — 
16. 98 56 0. S212 0. ee eee —} 6 ait 19 19 23 27 32| -43 -43 -1l1 02 — 
-9409 17 20 24 27 32| -78 -18 -04 O01 — 17 19 27 28 29| -75 25 — — —! gage 
-9965 17 20 23 30 30| -77 -19 -04 — —}| go, 19,20 21 29 31| -45 -32 -23 — — 
1-0000 18 18 25 28 31} -50 -50 — — ry 
17 19 26 27 31| -75 -25 — — — Bnwsaeii —-_— — = 
17 21 22 29 31| -78 -13 09 — — Te uf 0 Sk eee eee 
| |18 19 23 29 31| -56 +37 -06 — =| iat 17 22 23 26 32| -78 -11 -o8 -o3 —{| 450? 
ae 17 19 25 29 30| -75 -25 — — — 18 21 22 27 32| -61 -22 -16 -02 — 
: 17 19 28 28 28| -75 -25 — — —}| gogo 
’ 16 20° 87° etd: we ee ee 20 20 20 29 31| -33 -33 -33 — — 
| |16 23 24 25 32/1 ——— 3-466 
19 20 21 28 32| -45 -32 -23 — — 17 20 24 29 30/ -77 -19 08 — —))| gee, 
16 31 96.90 SOL1iG ae oe me + 18 19 24 28 31| -56 -37 -05 -0l1 —? 
16. 93. 58° 9. 9154-15), 26, =e =| = sik 18 18 27 28 29| -50 -50 — — —)| gen 
17 20 25 26 32| -78 -18 -03 -02 — 19 20 21 30 30| -45 -32 -23 — — 
18 19 24 27 32| -56 -38 -05 01 — 16 22 24 28 30}1 — — — —})| gags 
18 20 24 26 32/ -60 -29 -08 -04 —y 
6. 90 96.98 981.100. oe ee ee 
16 24 24 24 32/1 — — =H} se 6 sie seii —-_—- — 
20 20 20 28 32| -33 -33 -33 — — wasn salt. —-—'— m “70 
17 21 22 30 30| -78 -13 09 — — 17 22 24 25 32| -78 -1l -06 -04 — 
18 18 25 29 30| 50 50 — — —|| g4,, 19 20 22 27 32| -46 -33 -18 -03 — 
18 18 26 27 31| 60 50 — — — * 17 21 23 28 31| -78 «14 -07 -O1 rs Tr 
18 19 23 30 30| -56 -37 06 — — 17 20 25 27 31| -77 -19 03 01 — 
~siea73i1-—-— —i— 18 18 28 28 28| 50 50 — — — 
17 21 23 27 32| -78 -14 -07 -O1 me 3-696 20 20 20 30 30| -33 -33 -33 — 1} 4-616 
16 21 26 26 31/1 eee Sebi 16 23% 90920) — — —' + 
17 22 22 27 32| -78 -10 -10 O01 — 16 23 23 28 30/1 — — — —\|! geno 
16 22 23 29 30/1 — — — i sok 18 20 25 25 32| -60 -29 -06 06 — 
18 19 25 26 32| -56 -38 -04 02 — 19 19 24 26 32| -44 -44 -09 04 — 
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Rank analysis of incomplete block designs 








Zr, Ur, Lr, Ur, Ir, 








Pr Pa Ps Pa Ps B, ir, Zr, Urs Ur, Urs) Pr Pa Ps Pa Pz B, P 
n=4 (cont.) n=4 (cont.) 
"tee oS SS 18 19 25 29 29] -57 -37 -04 -01 -O1)| 5 45 
16 23 2 25 81}1 — — — —\l 14, 19 19 23 29 30} -43 -43 -11 -01 -01 
17 23 23 25 32] -78 -08 08 -05 — 17 20 26 28 29] -77 -19 02 -O1 -01\| . 20, 
19 21 21 27 32] -47 -25 -25 03 — 19 20 22 28 31] -46 -33 -18 -02 — 
17 22 22 28 31] -78 -10 -10 -01 a £040 BST Bits |S 1s 
17 20 26 26 31] -77 19 -02 02 — 16 24 25.25 30}1 — — —'—I! 5955 
18 23 23 24 32] -62 -14 -14 -10 — 
20 21 21 26 32] -37 -28 -28 -06 — 
BS SO Ril = = = na 5-026 
19 19 25 25 32| -44 -44 06 -06 — 17 21 24 28 30] -78 -15 -05 -Ol 3 5-980 
18 19 24 29 30 56 -37 -05 -0l1 — 5-045 18 20 24 27 31 -60 -29 -08 -03 -Ol 
18 19 26 27 30] -57 -38 -03 -02 -01)| . 9. 
16 21 27 28 98/1 — — — — 18 21 22 29 30| -61 -22 -16 -01 -Ol 
“hoa ees a 19 21 21 28 31] -47 -25 +25 -02 -01)| ¢ 95 
17 23 24 24 32| -79 -09 -06 -0¢6 — {| 563 17 20 27 27 29] -77 -19 -02 -02 -O1 
20 20 21 27 32| -35 -35 -26 -03 — 
16 22 25 27 30/1 — — — —)| , 2) Se Se Ss SS a oH ee 
18 21 23 26 32 “61 -22 -12 -04 =} F 19 21 23 25 32 49 -27 -16 -09 — 
17 21 24 29 29| -78 -15 -05 -01 pes 6-08e 
19 19 24 27 31| -44 -44 -09 -03 -01 
18 19 25 27 31] -56 -37 -04 -02 r= 5-178 17 22 24 26 31| -78 -11 -06 -03 — | 6-114 
17 21 23 29 30| -78 -14 -07 -01 — 
6 SDH Pile ow & fa 5-288 20 20 21 28 31| -35 -35 -26 -02 -O1)| 4 156 
18 22 22 26 32] -62 -17 -17 05 — 17 20 27 28 28| -77 -19 -02 -01 -01 
18 20 23 28 31| -60 -29 -10 -01 a hear 16 238 29% 2% 2j1 — = — ak 6-183 
17 20 25 28 30| -77 -19 03 01 — 19 22 22 25 32] -49 -21 -21 09 — 
Te oe le ee ee 
8 19 26 6 bee e ~} 5-328 19 21 24 24 33 an 27 +12 +12 =} vie 
18 19 6 31| -57 -38 -03 03 — 9 27 4716 ~ — 
oe oe 20 20 23 25 32] -37 -37 -16 -09 
"Su ) 
5-414 17 22 23 28 30| -78 -11 -08 -02 -01 
18 21 24 25 32| -61 -23 -09 -07 =} 18 20 25 26 31| -60 -29 -06 -04 Set 6-210 
19 20 23 26 32 47 -34 -14 05 — 17 23 23 26 31 ‘78 -09 -09 -04 | esis 
17 22 25 25 31| -78 -12 -05 -05 -01 
17 21 24 27 31| -78 -15 -05 -02 — | 5-424 ena 2 Pe es be 6-266 
19 19 23 28 31| -43 -43 -11 -02 — 18 19 26 28 29| -57 -38 03 -02 -01 
17 20 25 29 29| -77 -19 -03 -01 at oo a a eee oe me 6-316 
20 20 24 24 32] -38 -38 -12 -12 — 
18 21 22 28 31) -61 -23 -16 02 —)| . Wo, 
Pa 2 22a e 17 21 25 27 30| -78 -15 -04 -02 a 6-384 
18 21 23 27 31| -61 -22 -12 -03 -01 
16 22-26 27 29/1 a ae 17 22 23 29 29) -78 -11 -08 -01 st 6-364 
16 23 25 26 30/1 ea & a 19 19 25 26 31| -44 -44 -07 -05 -01 
18 22 23 25 32| -62 -18 -13 -o7 — {| 5868 18 19 27 27 29| -57 -38 -02 -02 4 6-300 | -0000 
19 21 22 26 32/] -48 -26 -20 06 — 19 21 21 29 30] -47 -25 -25 -02 -01 
18 19 25 28 30| -57 -37 -04 -01 -01)| 5 oo. 
18 20 22 29 30| -60 -28 -10 -0l iy os a ~ ro ro ; eae 
19 22 23 24 32| -50 -21 -16 -12 =} ree | on 
636% 2911 — — — ‘ 6-064 20 21 22 25 32] -39 -29 -22 -lo — 
19 20 24 25 32| -47 -34 -11 -08 — 
17 22 23 27 31| -78 -11 -08 -02 to ‘100 18 20 24 28 30] -60 -29 -08 -02 -O1 | 6-435] -0001 
17 21 25 26 31| -78 -15 -04 -03 — 17 21 26 26 30] -78 -15 03 -03 -01)| 6 469| .o001 
Bases 8ii1 — = = Hs, 18 22 22 27 31] -62 -17 -17 -04 -01 
6 6 }t — — — —Il LW, 17 23 24 25 31] -79 -09 -07 -05 -01 | 6-494] -0001 
18 22 24 24 32| -62 -18 -10 -10 — 18 19 27 28 28) -57 -38 -02 -02 -02\| ¢.554! .o90) 
20 20 22 26 32] -37 -37 -21 -06 — 20 20 21 29 30] -36 -36 -26 -02 sit 
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Ratex ALLAN BRADLEY 523 
Pal | 
| ir, Ur, Urs ory Urs} Pi Pa Ps Ma Ps B, P Er, Xr, Urs Ur, Urs| Pi Pa Ps Pa Ps B, P 
case | n=4 (cont.) n=4 (cont.) 
| Oe i Mw tee 18 22 24 25 31| -62 +18 -11 -08 -O1)! 7516! Joos 
/16 25 25 25 29/1 — — — —]) 9.44] oo) | 17 23 24 26 30] -79 -09 -07 -04 -O1 
| \19 23 23 23 32| -50 -17 -17 «17 — 16 26 26 26 26/1 — — — —}! aoos| goog 
| 21 21 21 25 32| -30 -80 -30 -10 — 22 22 22 22 32| -25 -25 -25 -25 — 
18 20 24 29 29] -59 -29 -08 -02 -02 19 20 23 29 29| -47 -B4 -14 -02 -02 
| |19 19 24 28 30| -44 -44 -09 -02 -01 6-589| -0001] 19 19 25 28 29| -44 -44 -07 -08 -o2f| 7270| “0004 
17 24 24 24 31| -78 -07 -07 -07 -o1 | 6-616| -ooo1| 12 23 25 25 30| -79 -09 05 -05 -O1\) 7.539) .o004 
sat ae ae ae a ce a oe 18 23 23 25 31| -62 -14 -14 -08 -01 
) 6-617| -0001] 18 21 24 27 30| -61 -23 -10 -04 -02 | 7-344] -0004 
eo 0 3 3 ee et ee oe mk 19 21 22 28 30| -48 -27 -20 -03 -02 
pene: See ues oes ae ae 18 20 26 27 29| -60 -29 -05 -04 -og}| 7365) -0005 
20 21 23 24 32| -39 -30 -18 -13 7 oF a 
19 21 23 26 31| -49 -27 -16 -07 -01 
17 22 24 27 30) -78 “11 +06 -03 -O1)| goa0| ooq)| 17 22 25 27 20) -78 -12 -05 -03 -o2f) 7907) “00s 
18 21 24 26 31| -61 -23 -10 -05 -01 17 24 24 25 30| -79 -07 -07 -06 -01)| ogy] .ooos 
19 19 24 29 29| -44 -44 -09 -02 -02 | 6-743| -0001| 18 23 24 24 31| -63 -14 -11 -11 -O1 
16 24 26 26 2/1 — — — — 19 22 22 26 31| -49 -21 -21 -07 -01)| .. , 
| 20 22 22 24 32| -40 -23 -23 -14 cad 6-778 | -0001] 17 92 26 26 29| -78 -12 -04 -04 cay Mgr = 4 Pe + 
17 22 25 28 28| -78 -12 -05 -02 -02 
18 20 25 27 30| -60 -29 -06 -03 ps 6-836| -0001| 20 20 23 26 31| -37 -37 -17 -07 -o1f| 7492) “0006 
17 23 23 27 30| -78 -09 -09 -03 -O1\| 6456) .o991| 20 20 22 28 30| -37 -37 -21 -04 2} fod Lies 
18 21 25 25 31| -61 -23 -07 -07 -01 48 -27 -20 -03 - 
17 21 26 27 29| -78 -15 -03 -02 -O1 1S eS) So ee oe oat 7-518 | -0006 
‘78 +15 -03 -02 - ' ; 19 19 26 27 29| -44 -44 -06 -04 -02 
‘119 21 22 27 31| -48 -27 -20 -04 ‘iy 6-867| -0002| 19 19 
18 21 25 26 30| -62 -23 -08 -06 -02 
| “ee | ot a ee ee 18 22 23 27 30| -62 -18 -14 -05 -o2/| 7583) “0007 
> 116 25 25 26 28/1 eis SB; Se pt 17 23 24 27 29] -79 -09 -07 -03 -02 ) F 
20 22 23 23 321 -40 -24 -18 -18 3 6-892) -0002] 19 21 24 25 31| -49 -28 -13 -10 -Ol Mire) ae ed 
21 21 22 24 32| -31 -31 -24 -14 — 18 20 27 27 28) +60 -29 -04 -04 -03 7-614| -0008 
|! 18 20 26 26 30] -60 -29 -05 -05 -Ol 6-063 |. -co0s 20 21 21 28 30); -38 -28 -28 -04 -02 
)} |18 22 22 28 30| -62 -17 -17 -03 ‘ay edie dal & Se ew 
17 22 25 26 30| -78 -12 -05 -04 -01 19 20 24 27 30| 47 -85 -11 -05 -02)) TO) OOS 
‘718 +12 -05 -04 - : : 19 19 26 28 28| -44 -44 -06 -03 -03 
} . ~ ” a po < i nm ~ 91) $975) -0002) 90 20 22 29 29| -37 -37 -21 -03 ‘03 ee 
‘44 +44 07 -04 - , : 20 21 22 26 31| -39 -30 -23 -08 -01 
SSSR 20 2 2 ae Ora See) eo a oe ae 
} |17 21 26 28 28/ -78 -15 -03 -02 <a} ee) oe 20 20 24 25 31| -88 -38 -13 -10 -Ol 7-797 -0010 
17 23 24 28 28| -79 -09 -07 -02 -02 
} lie os 28 7 7/1 —- —~ 2 = 20 21 21 29 29| -38 -28 -28 -03 re . ; 
‘0000 21 21 Ps 23 32 -81 -31 -19 -19 — 7:005| -0002/ 19 19 27 27 28 44 -44 -04 -04 -03 7-766 0010 
! 117 22 24 28 29! -78 -12 -06 -02 -02 17 23 25 26 29) -79 -09 -06 -04 ‘at q P 
19 20 24 26 31| -47 -35 -11 -06 ‘oy 7-008| -0003] 19 22 23 25 31| -50 -22 -17 -10 -o1s| 7879! “OOM 
TR en Se ee 
0001 21 21 21 26 31| -30 -30 -30 -08 -01 
18 22 22 29 29, -62 -17 -17 -02 -02 -838| « 
be ee on a0! td da 20s 05 ot] 72I5| 0003) 17 22 27 27 27| -78 -12 -03 -03 -o3f| 7888) “OOM 
21 22 22 +32 -25 -25 -19 — 18 22 23 28 29| -62 -18 -14 -04 -03 , . 
scent al ey co 19 20 25 26 30| -47 -35 -09 -o7 -o2f| 7858) “O0l2 
19 20 24 28 29| -47 -35 -11 -04 +03 | 7-897] -O012 
0001 20 21 21 27 31| -38 -28 -28 -05 -01)! 21121 coos 
eu 17 21 27 27 28| -78 -15 -03 -03 -02 18 22 24 26 30| -62 -18 -11 -06 -02 | 7-931| -0013 
) |18 20 25 28 29] -60 -29 -06 -03 = z-117{ -0003| 1% 24 24 26 20| -79 -07 -07 -04 _ oie | |edit 
0001 19 20 23 28 30| -47 -34 -14 -03 -02 19 22 24 24 31| -50 -22 -13 -13 -Ol 
> |19 20 25 25 31| -47 -35 -09 -09 -01 18 21 25 27 29| -62 -23 -08 -05 -03)| .. ' 
—t | [16 22 23 28 20/ -78 -00 -00 02 os} 7-183) -0003) 19 21 23 27 30| -49 -27 -16 -06 ‘02} re lee te 
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Rank analysis of incomplete block designs 





















































Er, Ur, Ir, Zr,g Us| Pi Po Ps Ma Ps B, P Er, Ur, Ur; Ure Urs} Pi Pe, Ps Pa Ds B, I 
n=4 (cont.) n=4 (cont.) | 
18 22 25 25 30 -63 -18 -09 -09 -02 19 21 24 27 29] -49 -28 -13 -06 -03 | 8-698 o0sr|| 
18 23 23 26 30| -63 -24 -14 -07 -o2f| S43) 0016) 5, 95 93 93 31] -33 -26 -20 -20 -02 : 
19 23 23 24 31| -50 -17 -17 -14 -O1 17 25 25 26 27| -79 -06 -06 -05 i B78 | SF | 
17 24 25 25 29| -79 -07 -06 -06 “o2} 8-049 | -0016) 5) 21 21 28 29] -30 -30 -30 -05 -04 8-710 | -008) 
17 23 25 27 28)| +79 +10 -06 -03 -03)| 2 69| ogig| 19 20 27 27 27] +48 -35 -06 -06 -06 
20 21 23 25 31| -39 -30 -I18 -11 -O1f 
18 23 24 26 29| -63 -15 -12 -07 -03 
8-748 | -0067| \ 
Qa © © 9 . . y . . . , 
19 22 22 27 30| -49 -21 -21 -06 -02f| ~ = . i< 8-766 | -0073| \ 
20 21 23 26 30! -40 -30 -19 -09 -03 
18 21 25 28 28 | -62 -23 -08 -04 -04)\) ¢ 598] .0020|17 25 26 26 26| -79 -06 -05 -05 -05 
20 20 23 27 30| -38 -38 -17 -06 -02/| | cet ae ort a ee 02} 8-811 | -0074 
17 23 26 26 28| -78 -10 -05 -05 -03)| 225! ooo] = TT OOF ” | 
20 22 22 25 31) -40 -24 -24 -11 -O1f| 19 21 24 28 28) -49 -28 -13 -05 -05\! 2219] ogre 
20 20 24 27 29| -38 -38 -14 -06 -04 
20 21 24 24 31| -40 -30 -14 -14 -01 19 23 23 25 30) +61 -18 -18 -1l dow . 
17 24 24 27 28| -79 08 -08 -04 -o3f| 8174| 0021) 18 23 95 95 29/| -63 -15 -09 -09 -o3f| *853 008 | 
19 20 25 27 29| -47 -35 -09 -05 -03 ; 5, | 18 22 26 26 28) -63 -19 -07 -07 -04)| | : 
19 21 23 28 29| -49 .27 -16 -04 .03}| 248} 0024) 09 99 99 96 30| -40 -24 -24 -09 “03} Pe? |. 
18 23 24 25 30| -63 -15 -11 -09 -02 | 8-264| -0025 
19 21 25 26 29] -49 -28 -11 -08 -04 
t 19 22 23 27 29| -50 -22 +17 -06 ‘os 6-018 joc 
: = Pe H + aw = 4 © at 8-283! -0026| 20 20 24 28 28| -38 -38 -14 -05 -05 | 8-941) -0094 | 
22 ‘31 “31 +24 +12 - 18 24 24 25 29| -63 -12 -12 -09 -03 
BB] ao 2 3 a sol sone] 0 22 3 3a 30] 1 ae ce “e a}] #0") cm 
18 21 26 27 28| -62 -23 -06 -05 -04)| aden! .0031| 18 23 24 27 28] -63 -15 -12 -06 -04 if 
| 18 22 26 27 27] -63 -19 -07 -06 -06) 
n ’ 8-982 | -0113 
19 22 22 28 29/ -49 -21 -21 -04 peal | 0033] 21 21 22 26 30) -32 -32 -25 -09 -03 
19 20 26 26 29! -48 -35 -07 -07 -03 20 20 25 26 29; -38 -38 -11 -09 eat 9-034 otal 
18 24 24 24 30/ -63 -12 -12 -12 -02 | 8-371| -0033] 19 22 23 28 28) -50 -22 -17 -05 -05 
20 20 23 28 29| -38 -38 -17 -05 -03 5 as | ‘dak 
19 20 25 28 28| -47 -35 -09 -04 -04 °%120 21 23 27 29) -40 -31 -19 -07 by! 9-144| -0130 
20 22 23 24 31) -40 -24 -19 -15 -Ol 8-388 | nest 19 21 25 27 28; -50 -28 -11 -07 -05 
17 24 25 26 28!) -79 -08 -06 -05 ‘os} 20 22 23 25 30| -41 -25 -20 -12 -03 9-185 | -0145 
18 23 25 26 28| -63 -15 -10 -08 -05 
Pe ys a eg 19 22 24 26 29] -50 -23 -14 -09 -04 | 9-228| -0182)) 
29| -63 +15 05 : 
8-426 | -0039 
19 21 25 25 30| -49 -28 -10 -10 ‘cat | 19 21 26 26 28] -50 -28 -08 -08 pr 
‘ 28 | -62 - 26 i , 9-249 -0160 
BS S| Se LM By ou] cole ao a 0K Kn oH : 
Bt St 31 27 30| 30 0 30 ao an}| 9°) 01/35 21 2 Se ae co 2 12 84] aur au 
bp°as GP Ga Sol ak ce AK cad ast 9-287 | -0171) 
| | 
17 25 25 25 28| -79 -06 -06 -06 -03 } 
20 23 23 23 31| -41 -19 -19 -19 ar} S408 | 0081118 93 95°27 27 | 163 15 710 06 3 9-293 | -0186! 
57 96) 95 $7/27,| :79 G8 00 06 OA)| 2 ee| opts oe ee aie] oo ee ete 
21 21 23 24 31| -32 -32 -20 -15 ot} 19 22 25 25 29] -51 -23 -11 -11 -04 9-331 | -0195| 
29| -63 -19 -09 -07 - 19 23 23 26 29] -51 -18 -18 -09 -04 i 
18 22 25 26 29| -63 -19 -09 -07 -03)| 2594) oor 
19 22 23 26 30! -50 -22 -17 -08 ‘o2} 19 21. 26 27 27) -50 -28 -09 -07 -07 9-358 | -0205 
21 21 22 27 29| -32 -32 -25 -07 -04 
20 20 25 25 30| -38 -38 -11 -11 -02 20 20 26 26 28| -38 -38 -09 -09 -05 
18 23 23 28 28| -63 -15 -15 -04 po 8-548 | -0048) 59 22 22 28 28| -40 -24 -24 -06 -06f| 9369) 0210 
20 21 22 28 29| -39 -30 -23 -05 -04 18 24 25 25 28| -63 -12 -10 -10 -05 
19 20 26 27 28| -48 -35 -07 -06 Set 8-598 | -0052) 09 23 23 24 30| -41 -20 -20 -16 ‘03} 9-388 | Ot 
17 24 26 26 27) -79 -08 -05 -05 -04 21 21 24 24 30| -32 -32 -16 -16 -03 ; 
21 22 22 24 31| +32 -25 -25 +16 ‘o2} 8-603 | -0055) 13 24 24 27 27| -63 -12 «12 -06 -o6s| 9994) -02%) 
—— ! ; 
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P lor, ir, rs Xr, Us| Py Po Ps Pe Ps B, P Zr, Ur, rs org Us| Pi Po Ps Me Ps B, P 
| n= 4 (cont.) n= 4 (cont.) 
| ] | 
; 18 23 26 26 27 | 63 -15 -08 -08 -06)| san | 20 22 25 25 28| -41 +26 +13 -13 -07 
008 || 21 22 22 25 4 33 -26 26 -13 -03}| %°39| “02371 59 03 23 26 28 | -42 -21 -21 -11 -07f| 10276) “1085 
-0060|| |19 22 24 27 28| -51 -23 -14 -07 -05 20 22 24 27 27) -41 -26 -16 -08 -08 
\|00 21 24 26 29| -40 -31 15 10 a 9-456 | -0261] 51 9) 24 26 28! +33 -33 «17 -11 -o7f| 1284, “1130 
-0061|} |20 20 26 27 27| -38 -38 +09 -07 -07 19 24 25 25 27| -52 -15 -12 -12 -08 
| 21 21 22 28 28| -32 -32 -25 -06 06} 9-478 | -0267} 9) 93 23 24 29| -24 -22 -22 -17 os} veend Hae 
0067) 119 23 24 25 29| -51 -18 +15 -12 -04 | 9-533| -0282 * ~ - 7 ~ ne = “~ = . 10-380 | +1245 
|19 23 23 27 28] -51 -18 -18 -07 -06 2 ‘83-33 +14 +14 © 
0073!) }09 21 25 25 29| -40 -31 -12 -12 a orf magpe be doth wh i A Gp oe as 
18 24 25 26 27| -64 -12°-10 -08 -06)\| | - . i Ie hae gy } 10-448 | -1357 
0074}! |) 99 93 24 30| -33 -26 -21 -17 at 9-595 | -0329] 22 22 23 24 29| +27 -27 +22 +18 -05 
| 20 23 24 25 28| -42 -21 -17 -14 -07 | 10-467| -1452 
-0078|; |19 24 24 24 29| -51 -15 -15 -15 -04 | 9-632) -0332] 90 22 25 26 27| -42 -26 +13 -1l > io-a7e |-cdis 
20 22 23 26 29| -41 -25 -20 -10 = 9-659 | -0369| 21 22 23 26 28| -34 27 -21 +11 -07 
0081]; |19 22 25 26 28 51 -23 +12 -09 -06 19 25 25 25 26! -52 -13 -13 -13 -10 \0-siat’ c1éea 
| |20 21 24 27 28| -40 -31 -15 -08 -06 | 9-682| -0388] 99 93 23 23 29)! -28 -22 -22 -22 -05 
.0085| |21 23 23 23 30| -33 -21 -21 -21 -03)| 4 44,1 oso, | 
18 25 25 25 27) -64 -10 -10 -10 06} 20 24 24 24 28) -42 -17 -17 -17 -07 | 10-561} -1703 
20 22 26 26 26| -42 -26 -11 -11 -ll 
0093 18 24 26 26 26| -64 +13 -08 -08 -08 | {22 22 22 26 28 | 27-27 «-27 ~«-1il ny 2O-OTE7 1968 
0094 | |22 22 22 24 30) -27 -27 -27 +17 oa} oe | 0401 21 = 23 a 1 “34 * J —7 pe 10-581} -1862 
oo | 22 22 25 27 27) -51 +23 -12 -07 on ores | -o4og| 21 21 25 26 27| -33 38-1 
“s § 9 D ° . ° . 5 i | ~ 
| te a rs a mt be > = a rd 21 22 24 25 28| -34 -27 -18 -14 | i dilie YS g e 
| pe a = -794| - ‘ ‘ ot P . 
(PERS S| coe a) em ome SARE) GT aa 
e1 2 26 2 Mod: 
| 29 22 22 27 27| -27 -27 -27 -09 ‘o9} Pe? |. 
O13}, |20 22 24 25 29) -41 -25 -16 +13 ay 58 | - 20 23 25 25 27| -42 -21 -14 -14 -09 
| 119 23 24 26 28| -51 -19 -15 -09 -06 | or ue thin a a 2 | -34 -22 -22 «14 ‘ort 10-760 | -2346 
-0118 19 22 26 26 27 51 -23 -09 -09 pi 2 san 
21 22 22 26 29| -33 -26 -26 -10 -05f| 9866| 0519) | | 8 | ge 
20 24 24 25 27| -42 -17 “17 -14 -09\| 10.555] conse 
| 20 21 25 26 28] -40 -31 -12 10 9-983 | -0576| 21 23 24 24 o8| -35 8 “18 -07 
o1g|| |20 22 23 27 28 | -41 -25 -20 -08 -06 | 20 23 25 26 26| -42 -21 -14 -11 -11\| jo556| orgs 
| 22 22 23 25 28| -28 -28 -22 -15 -07 
0145}; |20 23 23 25 29| -41 -20 -20 -13 ~ o-056| -o610| 2! 22 2% 26 27| -34 -27 +18 -12 -09 | 10-865| -2983 
RES Be aed aie | 20 24 24 26 26 | 43-17 “17 “ll -l 
19 23 24 27 27] -51 -19 -15 -08 -08 20 24 24 26 2 : , . ‘ 
| |21 21 24 25 29 | ‘33-33 -16 +13 os} 9-963) -0644) 22 22 24 24 28| -28 -28 -18 -18 ‘a mfr ages 
0160, |21 21 23 27 28| -33 -33 -20 -08 -06 21 22 25 25 - 34 -27 -14 -14 a 
LP BO ee os} 9-989 | -0679] 5) 93 93 96 27| -35 -22 -22 -12 9 40-988 | :8371 
0168 22 23 23 24 28| -28 -23 -23 -18 - 
| : 20 24 25 25 26| -43 -17 -14 -14 ‘11f| 1-040 —_ 
|} 119 24 24 25 28| -52 -15 -15 -12 -06 | 
0171 10-053 | -0720 
| |20 23 24 24 29| -42 -21 -16 -16 -05 01 22 25 26 26| $4 -28 -15 -12 -12)| 
Bin @ & pH ee “at 10-089 | -0764| 22 22 23 26 27| -28 -28 -23 -12 to} or ae 
Se Ble A A ts as 20 25 25 25 25| -43 -14 -14 -14 -14 
19 23 25 26 27| -51 -19 -12 -10 -08 - eS ee ‘ost 11-132 | -40¥8 
21 22 23 25 29| -84 -27 -21 -14 -05f| 10°150| -0866) 25 28 23 © 
0195 , 2 =, "as ; 21 23 24 25 27| -35 -23 -18 -15 -10 | 11-141] -4409 
0205), | 20 22 24 26 28| -41 -26 -16 -10 -06 |10:179| -0918] 21 24 24 24 27| -35 -18 -18 -18 -10 | 11-232) -4485 
21 22 24 24 29| -34 -27 +17 +17 -05 22 22 24 25 27) -28 -28 +19 -15 | 
| |19 24 24 26 27| -52 -15 -15 +10 me 10-255 -0980] 5, 53 24 26 26| -35 -23 -18 -12 -12f| 11236) 4048 
0210) |19 23 26 26 26| -52 -19 -10 -10 -10 22 23 23 25 27| -29 -23 -23 -15 -10)|,,. 
|| |22 22 22 25 29| -27 -27 -27 -14 os} 10:258| -1001) 5) 93 25 25 26| -35 -23 -15 -15 i2} AD-SR7 |, 
0221 
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Ratpn ALLAN BRADLEY 527 
Er, Ur, Ur, Ur, Urs| Pi Ps Ps Pa Ps B, ir, Ur, Urs org Urs| Pi Pa Ps Me Ps B, 
n=5 (cont.) n=5 (cont.) 
21 27 27 37 38] -82 -09 -09 — — 21 25 31 34 39) -81 -16 -02 -01 —)| . 49, 
22 23 31 37 37| -60 -40 — — —\)| 4, 21 26 29 35 39| -82 -13 -05 01 — 
22 23 33 33 .39| 60 40 — — — 20 27 30 35 38/1 — — — —}) ggg, 
23 23 29 37 38| -47 -47 05 — — 22 25 30 33 40| -66 -26 -06 -02 — 
sas anit =—- —- = — 21 24 33 36 36| -80 -20 — — — 
anonnieoii =- = = 4-398 21 24 34 34 37| -80 -20 — — —|| 4. 
24 25 26 35 40| -43 -32 -25 — — 23 26 26 36 39| -54 -23 -23 — — 
24 24 27 36 39! -41 -41 -18 — — 
2 379936 38)/1 — — — -} 437 | 
22 24 31 33 40| -64 -32 -03 -O1 — | 
chan & Ss & 3 4-459 23 23 30 35 39 -47 -47 -04 -O01 — 
2 25 35 35 35/1 — — — — © 3 ee odo. is ec oe Vee 
20 30 30 30 40/1 — — — —}/ 4-516 Dae ae) — — — | Taibeseee 
23 25 28 34 40| -54 -31 -14 -02 — 
92 24 32 32 40| -64 -31 -02 -o2 —{| #586 | 
23 23 31 33 40| -47 -47 -03 02 — 0 106 Tie be 4 
21 25 30 35 39/| -81 -16 -02 — — | 4-642 - - = a Z| 4 4 sar ‘lhe el 5-496 
= os Wi he mF 21 25 32 33 39/| -81 -16 -02 -O1 7 5-801 
[.eaeeie Lf & 21 27 28 35 39| -82 -10 -07 -01 — 
20 2 — = So ee 20 27 30 36 37/1 ee ee ey 
21 26 30 33 40| -82 -13 -04 -02 — 20 28 29 35 38/1 ae aa a 
2 So | > 22. 22 25 31 32 40) -66 -26 -05 -04 —/| 50 
S22 Me) ew oe an 23 24 30 33 40| -52 -38 -07 -03 — 
21 24 33 34 38) -80 -20 — — —|! 495 
22 26 27 36 39| -67 -19 -14 — — 
23 24 28 36 39| “52 -38 -1l1 — — 20 26 32 36 36/1 —-—--—-— 
20 29 29 33 = ' — — + +Vicgn 
20 28 28 37 37/1 - Pr tes 21 27 31 31 40| -82 -11 -04 -04 — 
23 23 32 32 40| -48 -48 -02 -02 — 24 24 28 34 40| -42 -42 -14 02 — 
22 23 32 35 38| 60 40 — — is) vam 21 24 35 35 35| 80 -20 — — i | 5-802 
22 25 28 37 38| -66 -25 -09 — — 25 25 25 36 39 | 33 33 33. — — 
20 26 31 36 37/1 —-— s+. = 
20 28 29 34 39/1 —_—---— — | 
a1 36 31 32 40 | “62 39 a8 2 zt wh 1 2eee S222 5 
23 24 29 34 40| -52 -38 -09 -Ol _aae 38 | i Se af 5-620 
(24 24 27 37 38| -41 -41 -18 — — 
> = - os = ; Boy ae he 22 24 30 36 38 | -64 -32 04 — — | 5-622 
21 27 29 33 40| -82 -10 -06 -o2 —[| *074| 
22 26 28 34 40| -67 -20 -12 -01 — 20 26 33 34 37/1 ie fide. fee abe 
22 23 32 36 37| 0 -40 — — —+}| 20 28 31 32 39/1 — — — |) gg09 
9 é . — r 
~ = vs = > = = i 2: 4] 5-107 21 28 29 32 40| -82 -08 -06 -03 — 
22 2 23 26 27 34 40 -55 -24 -19 -02 — 
23 24 28 37 38| -52 -38 -ll — — 20 27 31 34 38/1 —--—--—--- 5-714 
wha dk 22 26 29 33 40! -67 -21 -09 -03 = 
2 5 37| 80 20 — — —} 5-121 | 
23 25 27 36 39| -53 -30 -17 — —J)| | 
21 25 30 36 38| -81 -16 02 — —})| 5-138 | 21 26 29 36 38, -82 -13 05 — i | 5-198 
22 24 30 35 39| -64 -32 -04 -O1 aH 22 24 31 34 39| -64 -32 -03 -O01 — 
20 26 33 33 38/1 —-—— = = 20 28 29° 36 37/1 [sao 5-770 
20 27 32 32 39) 1 — — — —|h gras 23 24 31 32 40| -52 -38 -06 -04 — 
21 28 28 33 40| -82 -08 -08 -02 —[| 22 24 30 37 37: -64 32 -04 — Bia 5-771 
22 27 27 34 40| -67 -16 -16 -02 — | 23 23 30 36 38! -47 -47 -04 O01 — 
| 
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rc ‘ 
P | Dr, Ur, ory Uy rs} Pi Pa Ps Me Ps B, P. ir, Xr, Ur, Ur, Xrs| Pr Pa Ps Pa Ps B, P 
ali 
n=5 (cont.) n=65 (cont.) 
| 21 26 31 34.38| -82 -13 -03 -02 a ‘068 23 23 33 34 37| -48 -48 -02 -02 -O1\! 2444 
| }22 26 29 34 39| -67 -21 -10 02 — 23 26 27 37 37| -55 -25 -19 -O1 -O1 
21 27 31 32 39| -82 -11 -04 -03 —)| ¢ 994 21 27 30 34 38| -82 “11 -05 -02 -O1)| 9445 
21 28 29 33 39| -82 -08 -07 -02 — 22 26 30 33 39] -67 -21 -08 04 — 
21 28 28 35 38| -82 -08 08 -01 —\| ¢.o9¢ 21 26 31 36 36| -82 -13 -03 -01 -O1\| 2 4n9 
22 25 32 32 39| -66 -26 -04 -04 — 24 24 29 34 39| -42 -42 -12 -03 — 
21 25 33 35 36| -81 -16 -O1 -O1 -O1 
oo 98 08.98 IU a a eH 
} +44 4 7 2 : oe oe 23 28 28 31 40| -57 -17 -17 -09 —j| 74°? 
i i a cae 24 27 27 32 40| -46 -23 -23 -07 — 
| 22 29 29 30 40| -68 -11 -11 09 — {| 7 #0 
| 25 26 26 33 40] -37 -29 -29 -05 — > este telel 
22 24 32 35 37| -64 -32 -03 -01 -01 | 2M NDS. -— =— — SAl-eee 
| [23 25 28 36 38| -54 -31 -14 -01 -o1f| 7°*| SSR ess eS 
{ 190 96 68011 a oe ee ot St NW 
23 27 28 32 40| 56 -21 -17 -06 ae ee Ss os oF eeiea] ia aa le ee ere 
20 29 30 34 87/1 — — — —|| nog, 
23 26 30 31 40] -56 -26 -10 08 — 22 25 31 34 38] -66 -26 -05 -02 -01)| 7.69 
24 25 29 32 40| -45 -35 -14 -06 — | 22 26 29 35 38| -67 -21 -10 -02 -0l 
21 29 30 31 39| -82 -07 -06 -04 — | 7-617 
| |o2 25 30 35 38| -66 -26 -06 -02 -o1 | 7-104' 22 24 34 34 36| 64 -32 -02 -02 -O1)| 2695 
21 25 34 34 36| -81 -16 -O1 -O1 -01 7-145 | 24 26 26 36 38| -44 -27 -27 -O1 -O1 
| 24 26 26 35 39| -44 -27 -27 02 — 
21 27 29 36 37) +82 +10 -06 -01 het 7146 | 23 24 30 36 37| -52 -38 -07 -O1 -O1 | 7-636 
23 24 31 33 39 52 -38 -06 -03 — | 21 28 29 34 38 ‘82 -09 -07 -02 -Ol 7-663 
| 22 26 31 32 39| -67 -21 -06 -05 -01 
| [22 24 32 36 36) -64 -32 -03 -01 -01 7-188 | 22 23 33 35 36| -48 -48 -02 -O1 -O1 ; 
24 24 28 36 38| -42 -42 -15 -01 -O1 24 25 27 37 37! -44 -34 -20 -o1 ors] 7O72 
21 26 82 83 38| -82 -13 -03 02 —\| 7 o9.| 
22 27 28 34 39] -68 -17 -13 -03 — 
| |93 93 32 35 37 2 ‘es b~ 01 -01)| 2.017 | a8 SS ae ae tae at 7-673 
| 23 25 28 37 37| -54 -31 -14 -O1 ‘oi | a a . Bess = eS 
21 25 34 35 35| -81 -16 -O1 -01 -O1 20 81 St hh CU Aegon 
| [25 25 26 35 39| -35 -35 -27 -02 tod speed, BS eon) we St 
| |21 28 28 36 37| -82 -08 -08 -01 -01)| 7563. 25 26 27 32 40) “85 “30 24 US — 
| |23 24 32 32 39| -52 -38 -05 -05 — 
22 24 33 34 37| -64 -32 -02 -02 pe i alte | 20 29 31 34 36/1 — — — —}] a6, 
| |28 26 27 36 38| -55 +24 -19 -O1 -O1 | 24 26 29 31 40| -46 -29 -15 09 — 
21 30 30 30 39| -82 -06 -06 -06 — | 7-717 
20 29 30 35 36/1 — — — —}\| 294) 22 24 34 35 35| -64 +32 -02 -01 -01)! 224) 
| 24 25 30 31 40| -45 -35 -11 -09 — | 25 25 26 36 38| +35 -35 -27 -O1 -O1 
(21 28 30 32 39| -82 -09 -05 03 — | 7-308 | 
} | O¢ ? : : R ’ | : 
et ee ta at ae ae oY 4 21 27 31 33 38| -82 -11 -04 -03 -01)| 226) 
rn 22 27 29 33 39| -68 -17 -11 -04 -01 
| | 
| [21 26 31 35 37) -82 +13 -03 -O1 * ae > ean ane ae a a a 
23 25 29 34 39| -54 -31 -11 03 — 7-775 
as 95 90 os ol ie as 4s Ga 23 29 29 29 40| -57 -14 -14 +14 — 
BA ™ 7-370 | 26 26 26 32 40| -31 -31 -31 -08 — 
23 24 30 35 38| -52 -38 -07 -02 -01 . . 
0 ieee hae oe ce be | 21 26 33 33 37| -82 -13 -02 -02 -01\| 2249 
20 29 31 33 37;1 — — — —\|/ ,4.! 23 27 27 34 39| -56 -20 -20 -03 -01 
23 27 29 31 40| -56 -21 -14 -09 — | 23 23 34 34 36| -48 -48 -02 -02 -01)| 2225 
| [24 26 28 32 40| -46 -29 -18 -07 — 24 26 26 37 37| -44 -27 -27 -O1 -Oi 
21 28 31 31 39| -82 -09 -04 -04 —)| a 41s 22 25 32 33 38| -66 -26 -04 -03 -01)| 7199 
, [21 29 29 32 39) -82 -07 07 03 — 22 27 28 35 38| -68 -17 -13 -02 -01 
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Er, Ur, Urs Ure Us| Py Pao Ps Pa Ps B, Zr, Ur, Urs Ure Urs} YP. Pa Ps Pe Ps B, 
n=65 (cont.) n=65 (cont.) 
] | 
Senuswie 2 & & = 22 25 32 34 37| -66 -26 -04 -03 ony é alt 
Shon MwI1I Coe i aaa | 23 26 28 35 38| -55 +25 -16 -03 01! 
24 26 30 30 40| -47 -29 -12 -12 — 0 29 3.8% Mil > — © = 4}! 
25 25 29 31 40| -87 -37 -16 -10 — 20 31 31 32 36/1 — — — —|) go, 
21 27 30 35 37) -82 -11 -05 -O1 -01)| 2615 24 28 29 29 40| -48 -20 -16 -16 — 
23 25 30 33 39| -54 -32 -09 -04 -01 | 26 26 27 31 40| -82 -32 -26 -11 — 
! 
22 26 29 36 37| -67 -21 -10 -02 -Ol | 
23 24 31 34 38| -52 -38 -06 -03 -Ol ad wine 2 oe ee 
Sb 57 SF 08) 98) OS BL OS 108 OR)! 15 06) | 21 28 31 32 38| -82 -09 -04 -04 -O1 
22 28 28 33 39| -68 +14 +14 -04 = 6 5 96° he bol a8 4 41 a8 aat| © 2% 
ae aieii. — — — —} nee 21 26 34 34 35| -82 -13 -02 02 -O1 
24 27 28 31 40| -47 -24 -19 «10 — mo ie tel cy ae ae oe oi 8-302 
23 23 34 35 35/ -48 -48 02 -O1 -31)| 1 506 
25 25 26 37 37| -35 -35 -27 -O1 -01 23 24 31 36 36! -52 -39 -06 -02 ps 6-380 
2190 ih ee a oe "74 sane 24 24 29 36 37| -42 -42 -12 -02 -Ol 
25 25 30 30 40| -38 -38 -12 -12 — 22 25 33 33 37| -66 -26 -03 -03 -01)) ¢ 65 
21 26 32 35 36| -82 -13 -03 -01 pa 76s | 23 27 27 35 38/| -56 -20 -20 -03 -01 
24 25 28 34 39| -44 -35 -17 -04 -01 21 27 32 33 37| -82 -11 -03 -03 -01)| ¢ 41g 
23 27 28 33 39| -56 -21 -17 -05 -01 
21 27 30 36 36) -82 -11 -05 -01 -01\| 7 o9¢) 
24 24 30 33 39| -42 -42 -10 -05 -01 
22 25 31 35 37| -66 -26 -05 -02 -01 22 26 $1 33 38/ -67 -21 -06 -04 or 8-436 
23 25 29 35 38| -54 -31 +11 -02 of 7-938 | 22 27 29 34 38| -68 -17 -11 -03 -O1 
@1 28 29 35 37| -82 -09 -07 -02 -01 21 27 31 35 36| -82 -1l -04 -02 ~ 8-438 
8-026 24 25 29 33 39] +45 -35 -14 -05 -Ol 
23 26 31 32 39| -54 -32 -08 -06 “ony 
20 30 32 33 35/1 — — — —}! giggo 
22 27 28 36 37| -68 -17 +13 -02 -O1)| 2 9.5 SPR PO) Pew 
23 24 32 33 38| -52 -38 -05 -04 -O1 
22 25 31 36 36) -66 -26 -05 -02 my, 8-055 | 21 29 30 32 38| -82 -07 -06 -04 -Ol 8-470 
24 24 29 35 38| -42 +42 -12 -02 -0l | 22 28 30 31 39 | 68 -14 -09 -07 -Ol 
21 28 30 33 38); -82 -09 -05 -03 aif 8-075 | 22 25 32 35 36! -66 -26 -04 -02 -02 8-478 
22 27 30 32 39 -68 -17 -09 -05 -Ol 24 25 28 35 38! -44 -35 -17 -03 ‘cat “47 
| 22 26 30 35 37| -67 -21 -08 -02 -01 + 
ae wee lh. sx oo 7 23 25 30 34 38| -54 -32 -10 -04 -01 
20 30 31 33 36/1 — — — —|) gyn! 
24 27 29 30 40| -47 -24 -16 -13 —f[| | 
295 26 28 31 40| -39 -31 -20 -10 —J| 23 24 32 34 37) -52 -39 -05 -03 2 8-520 
| 23 26 28 36 37| -55 -25 -16 -02 -02 
21 26 33 34 36| -82 -13 -02 -02 ‘ony bali | 21 28 30 34 37) -82 -09 -06 -02 si 8-529 
24 26 27 34 39! -45 -28 -22 -04 -O1 23 26 30 32 39| -56 -26 -11l -07 -O1J| 
22 26 30 34 38 -67 -21 -08 -03 -Ol | 8-124 22 26 32 32 38 ‘67 -21 -05 -05 or 8-537 
21 28 29 36 36| -82 -09 -07 -Ol ‘oy 6-148 22 28 28 34 38) -68 -14 -14 -03 -01 
24 24 31 32 39/ -43 -43 -08 -06 -01 | =| 
| kk hee ee 
2S Pi Mike on or or =F 20 31 31 33 35/1 ree we 
20 30 32 32 36/1 > or < “ice 25 27 29 29 40| -40 -26 -17 -17 —{| * 54 
25 27 27 31 40) °39 25 -25 “11 —/J) 21 29 31 31 38| -82 -07 -05 -05 -01)| 
21 29 29 33 38| -82 -07 -07 -03 ‘on sree | 22 99 29 31 39| -68 -12 +12 -08 ‘ot 8-565 
22 27 31 31 39| -68 -17 -07 -07 -O1f| 
23 24 31 35 37| -52 -39 -06 -02 ony o-ane | 22 26 30 36 36| -67 -21 -08 -02 os) e-em 
23 25 29 36 37| -54 -31 -11 -02 -o1f| "~~ 24 24 30 34 38| -42 -42 -10 -04 -01 
21 26 33 35 35| -82 -13 -02 -01 ‘ony Lie | 23 24 33 33 37| -52 -38 -04 -04 -01)! 9 95 
25 25 27 34 39| -36 -36 -23 -04 -01 _ 23 27 27 36 37| -56 -20 -20 -02 -02 
21 27 31 34 37/ -82 -11 -04 -02 -01)| 9.05, 21 29 29 34 37) -82 -07 -07 02 -01)) 9 g59 
23 26 29 33 “f ‘56 +26 -13 -05 -Ol wr | 23 26 31 31 39| +56 -26 -09 -09 -01 
ae | 
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' [rs ir, Sry Zry drs| MP, Pe Ps Me Ps B, } =r, Ir, Urs Lrg =r5| Pi Ps Ps Me Ps B, P 
n=5 (cont.) n=5 (cont.) 
2 
20:98 98 Sub los ee me me eo 20 32 32 33 33/1 — — — —}| gogs 
2% 31 32 32 35/1 — — — —|) ,.,, 27 27 28 28 40/| -28 -28 -22 -22 — 
25 28 28 29 40/ -40 -31 -21 -17 — | 21 29 30 33 87] -82 -07 -06 -03 -01)| 9415 
2% 27 27 30 40| -33 -27 -27 -14 — 23 27 30 31 39| -57 -22 -11 -09 -Ol 
2 31 31 34 34/1 — — — —}| 94, 22 28 28 36 36) -68 -14 -14 -02 -02)| 019 
2% 26 29 29 40| -32 -32 -18 -18 — 24 24 32 32 38| -43 -43 -07 -07 -O1 
21 30 30 31 38] -88 -06 -06 -05 -Ol 21 27 33 34 35] -82 -11 -03 -02 of 9-022 
22 29 30 30 39! -69 -12 -09 -09 -O1 8-660 25 26 27 33 39| -38 -30 -24 -06 -01 
22 25 33 34 36| -66 -26 -04 -03 -02 22 27 31 32 38/| -68 -18 -07 -06 -0l 9-031 
2% 26 27 35 38| -45 -28 -22 -03 at 8-681 22 28 29 33 38| -68 -14 -11 -05 -Ol 
21 27 32 34 36/| -82 -11 -083 -02 -O1 23 24 33 35 35] -52 -39 -04 -03 -03 9-047 
24 26 28 33 39| -46 -29 -19 -06 -o1;| 2°73! 25 25 27 36 37| +36 -36 -23 -02 -02 
SxunBiti Owe ee | 24 24 30 36 36| -43 -43 -10 -02 -02 | 9-084 
~ } 8-741 | 22 26 32 33 37| -67 -21 -05 -04 -02 
24 25 28 36 37| -44 -35 -17 -02 -02 9-090 
i ite | 23 27 28 34 38| -56 -21 -17 -04 -O1 
21 28 30 35 36| -82 -09 -06 -02 -01 
se 96 96.08 1 le ee oe of 8-744 22 26 31 35 36| -67 -21 -07 -03 -02\| 914, 
24 25 29 34 38| -45 -35 -14 -04 -O1 
22 25 33 35 35| 66 -26 -04 -02 -02 82 -11 -02 -02 - 
25 25 27 35 38| -36 -36 -23 -03 ou oy SSS ial a ae 
22 27 29 35 37| -68 -17 -11 -03 -02 4 
BE \ 8-798 21 28 31 34 36| -82 -09 -05 -02 -02)| 9 154 
Scr as ae ee = 32 -08 -05 -01 24 26 29 32 39| -46 -29 -15 -08 -01 
=< o = Tl iets 23 24 34 34 35| -52 -39 -03 -03 -03)| . 
27 28) 39 40) 38 27 123 18 — 25 26 26 36 37| -37 -29 -29 -03 -o2s| * 147 
21 28 31 33 37| -82 -09 -05 -08 D> iolk 21 29 31 32 37| -82 -07 -05 -04 > own 
23 27 29 32 39| -57 -22 -14 -07 -Ol 23 28 29 31 39| -57 -18 -15 -10 -01 
21 27 33 33 36 | -82 -11 -03 -03 ps 8-826 21 28 31 35 35| -82 -09 -05 -02 -02)| 9.554 
24 27 27 33 39| -46 -23 -23 -06 -Ol 25 25 29 32 39| -38 -38 -16 -08 -01 
21 27 32 35 35) +82 -11 -03 -02 -02)| 6 a9 23 25 31 34 37| -54 -32 -08 -04 02)! oo. 
25 25 28 33 39) -37 -37 -19 -06 -Ol 23 26 29 35 37| -56 -26 -13 -03 -o2} 
22 27 30 33 38| -68 -18 -09 -05 -01 | 8-838 21 30 30 32 37/ -82 -06 -06 -04 at 9-286 
21 29 29 35 36/ -82 -07 -07 -02 -O1 8 23 28 30 30 39/| -57 -18 -12 -12 -Ol 
24 25 31 31 39| -45 +35 -09 -09 on rer 22 27 30 34 37| -68 -18 -09 -04 02 : is 
23 25 30 35 37| -54 -32 -10 -03 -02 | 8-852 23 26 30 33 38| -56 -26 -11- -06 -01 
22 25 34 34 35| -66 -26 -03 -03 -02 21 28 32 33 36! -82 -09 -04 -03 -02)| . ; 
25 26 26 35 38| -37 -29 -29 -03 ‘oi 7 24 27 28 32 39| -47 -24 -20 -08 -o1s| 309) “0000 
22 26 31 34 37] -67 -21 -07 -03 -02 21 29 30 34 36/ -82 -07 -06 -03 -02 ‘ ‘ 
23 26 29 34 38| -56 -26 -13 -04 sit sli 24 26 30 31 39| -47 -30 -13 -10 -o1f| 9S!#| “00! 
22 28 298 35 371 . ; 22 28 30 32 38] -68 -15 -10 -06 -01 | 9-314] -0001 
r SS Si aes 23 26 29 36 36| -56 -26 -13 -03 -03 
23 25 32 32 38| -54 -32 -06 06.01} i: ae an on . . 
24 24 31 34 37| -43 -43 -08 -04 -oas| 9370| “0001 
i ee eis 2S YS ‘83 -06 -05 -05 -01 
ema el: ——— Hl ey) [B22 8) oe SS 8h oom] om 
otal a i RB ee 22 26 32 34 36| -67 -21 -06 -04 -02 ve 
27 27 27 29 40| -27 -27 -27 -18 — 24 26 28 34 38| -46 -29 -19 -05 -o2f| 9400) “0001 
21 28 32 32 37] -82 -09 -04 -04 ‘of 8-912 22 28 31 31 38] -68 -15 -08 -08 --O1 9-407| -0001 
23 28 28 32 39 +57 -18 -18 -07 -0l 22 29 29 32 38 -69 -12 -12 -06 -Ol 
22 27 29 36 36| -68 -17 -11 -02 -02 21 29 30 35 35| -82 -07 -06 -02 -02)| . ' 
24 24 31 33 38| -43 -43 -08 -05 eu ot 25 25 30 31 39| -88 -38 -13 -11 -o1f| 9 #13) “0001 
23 24 33 34 36| -52 -39 -04 -03 -02 23-25 32 33 37| -54 -32 -07 -05 -02)| . ; 
24 26 27 36 37] -45 -28 -22 -02 ‘at eo 23 27 28 35 37| -56 -21 -17 -03 a 9-450 | -0001 
23 25 30 36 36| -54 -32 -10 -02 -02 23 25 31 35 36| -54 -32 -08 -03 -03)| o. ; 
24 24 30 35 37) -43 -43 -10 -03 ‘oz <n 24 25 29 35 37| -45 -35 -14--04 -oaf| 9472) “000! 
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[| 
P Lr, Ur, Urs org Ls) Pi Ps Ps Me Ps B, P Zr, Ur, Urs Lrg Us| Pi Po Ps Pe Ps B, P 
= 
| n=5 (cont.) n=5 (cont.) 
‘ | 22 28 30 35 35| -68 +15 -10 -03 -03 24 25 32 33 36| -45 -36 -08 -07 -04 
7: | 25 25 30 32 38| -38 -38 -13 -09 a} 10-250 0003/54 27 28 35 36| -47 -24 -20 -05 a POR bs OR 
2% 24 34 34 34) -43 -43 -05 -05 -05)|_. ; 21 32 32 32 33| -83 -05 -05 -05 -04)|,, 
0002) [26 26 26 36 36| -31 -31 -31 -03 03} 10-256 | -00031 07 28 28 28 39| -28 -23 -23 -23 a} EOP ORD. 
22 29 31 31 37| -69 -12 -08 -08 -02)|_. 22 29 31 32 36| -69 -13 -09 -07 -03)|,,. ; 
0002! / /23 29 29 31 38| -58 +15 -15 -10 ‘o2} 10-294 | -00041 94 98 29 31 38| -48 -21 -17 -12 -o2s| 1762) -0008 
21 31 31 32 35| -83 -05 -05 -04 -02) , 
( . 10-298 | -0004] 22 28 32 33 35] -69 -15 -07 -06 at ” * 
ae Ee TE Nef Ble iter Bier Bi pe! 25 27 28 32 38| -40 -26 -22 -10 -o2f| 1776) “0008 
‘ 23 2 ‘57 +18 +18 -04 -03)! 1.303! .oo04| 22 29 30 34 35] -69 -12 -10 -05 -04)|,, , 
ae BE Be Eh Be Plies. Baten pe: a} 25 26 30 31 38| -39 -32 -14 -12 -ogf| 1777) “0008 
2 ° . . 05 - 9 5 . . 
‘ 10-325; -0004] 23 27 30 35 35 57 +22 -12 -04 -04 i , 
mi | 24 26 29 34 37] -47 -30 +16 -06 -03} 25 25 30 33 37| +38 -38 -14 -07 -o3y| 10780, “0010 
0002} | |22 27 33 33 35| -68 -18 -05 -05 -03)|__ bas 
| 125 27 27 33 38| -39 -26 -26 -07 -o2f| 19338) 0004) 23 26 33 33 35) -56 -27 -06 -06 -04\! 10.761! .oo10 
-0002 22 29 29 35 35! -69 -12 -12 -04 -04 aoe 25 27 27 34 37| -39 -26 -26 -06 -03 
25 25 31 31 38| -38 -38 -11 -1l ‘o2} ee eet nr nae cae ae aeons oer 
-0002| {| |22 30 30 31 37| -69 -10 -10 -08 -02 : 4 < sa ae aa aoe \ 10-846 | -0010 
23 29 30 30 38| -58 +15 -13 -13 ‘02 } | 10-380 0004] 24 28 30 30 38| -48 -21 -14 -14 -02 
: 23 27 30 33 37) -57 -22 +12 -06 -03 | 10-383) -0004] 23 28 29 34 36] -57 -18 -15 +06 -04)/\). 
. 21 30 32 33 34/] -83 -06 -04 -04 pes soees| cee 24 26 31 32 37] -47 -30 -11 -09 -03 10-857 | -0011 
0008 | 2 27 28 30 39! -34 -27 -23 -15 -O1 22 28 32 34 34] -69 -15 -07 -05 -05 10-866! -0011 
22 28 31 33 36| -69 -15 -08 -05 -03)| 9.4171 .9995| 20 26 28 32 38| -33 -38 -22 -10 -02 
0002 | 24 27 29 32 381 -48 -25 -17 -09 -o2} 23 26 33 34 34)| -56 -27 -06 -05 -05 10-872 | -0011 
26 26 27 34 37| -32 -32 -26 -06 -03 
23 26 31 35 35] -56 -27 -09 -04 -04 
all | 25 25 29 34 37| -38 -38 -16 -06 “ct 10-423 | 0005) 53 28 31 31 37| -58 +19 -10 10 -08 io-obis, |" Sodid 
wal SESE SSS Bom oolk BREE SS SS Se) cu 
a1 a1 a1 33 u 5 08 o 03)| 10.472! -0005| 25 26 28 35 36| -39 -31 -21 -05 -04 
~~ ‘84 +28 +19 -19 -O1f 22 30 31 31 36| -69 -11 -09 -09 -03)| 1.939! ooze 
| OE Le) Daal al ete P= 24 29 29 30 38| -49 -17 -17 -14 -02 
| AR BT Rl a 01} 10473 | 0009 | 93 27 31 83 36| “57 -22 10 -07 -04 10-944 
ory . ~ . “4 we ~ ee = pe! 10-504| -0005| 24 27 29 33 37| -48 -25 -17 -08 -03 ee 
0003}/ |23 26 32 33 36| -56 -27 -08 -06 -03 oe eee oe ey ee ee oe naan | eee 
} 10-504} -0005| 26 27 27 32 38| -83 -27 -27 -10 -02 
.0008 24 27 28 34 37 47 +24 -20 -06 *03 23 28 29 35 35 *567 -18 -15 “05 “o3} 10-954 0013 
24 25 31 34 36| -45 -86 -10 -05 <a epee ee 
| fees ae ny Oe See Oe oe 24 26 30 34 36| 47 +30 -13 -06 -04 |10-982| -0014 
-0003|| |21 31 32 32 34| -83 -05 -04 -04 -03\|,_. . 
| |26 28 28 20 30| -34 -23 23 .19 -o1f| 10556] -0006] 24 25 33 33 35| -46 -36 -07 -07 pe ‘lis |° Sede 
.0003|| |23 27 31 32 37| -57 -22 -10 -08 -03} sibel fielded Bitoni ane monk pa 
| les 98 29 38 37| .67 .18 15 .07 .ogt| 10°559| -0006] 23 27 32 32 36] -57 -23 +08 -08 -04)/1).999| Logis 
0003} | ) 24 28 28 33 37| -48 -21 -21 -08 -03 
22 29 30 33 36| -69 +12 -10 -06 -03 
0008 24 27 30 31 38! -48 -25 +14 -1l pe 10-591 | -0006/ 99 29 31 33 35| -69 -13 -09 -06 , 13-081 | -od1s 
22 5 5| -69 -15 -08 -05 -0 25 27 29 31 38| -40 -27 -18 -12 -02 
28 31 34 35] -69 -15 -08 -05 -04)! 19.604| .o007 
0003} |25 26 29 32 38| -39 -32 -17 -10 ‘oa 2 * ~ <. . “ ion oo o. - 11-071 | -0016 
24 25 31 35 35| -45 -36 +10 -04 -04 4 26 5 47 +30 -13 -05 } 11-079 | -0016 
0008 + |25 25 29 35 361 -38 -38 -16 -05 ‘ost 10°634 | -0007} 95 25 30 34 36] -38 +38 +14 -06 -04 
} |21 31 32 33 33] -88 -05 -04 -04 -04)|,. 24 25 33 34 34| -46 -36 -07 -06 oa) { 
ooog] | {27 27 28 29 39] -28 -28 -23 -19 “ort | 10-641} -00071 35 36 27 35 36| a2 -32 .26 .05 -o4f| 11-082) -0016 
|) |23 27 30 34 36] -57 -22 -12 -05 -03 22 29 32 32 35| -69 +13 -07 -07 -04 
0003} | |24 26 30 33 37] -47 -30 -13 -07 -03} 10-683 | -0007) 59-30 30 33 35| -69 “11 “11 -06 -04(| 1) 145] .oon7 
} |23 26 32 34 35| -56 -27 -08 -05 -04)| 15 592| goog] 25 27 30 30 38) +40 +27 +15 +15 -02 
all 25 26 28 34 37| -39 -31 -21 -06 ‘03 25 28 28 31 38| -41 -22 -22 -13 -02 
} 














Rank analysis of incomplete block designs 








Lr, Ur, Urs Ur, Urs 





=r, Ur, Urs Ur, XUr; 

















22 
26 
23 
25 
23 


25 
23 
24 
22 
26 


24 
24 
22 
25 
23 
24 


22 
26 
23 
25 
24 
24 


24 
25 
22 
25 
23 
24 


22 
27 
23 
25 
23 
26 


24 
25 
24 
25 
22 
26 


23 
25 
23 
26 
25 
25 


23 
24 
22 
26 
24 





a 


wpwnwnwnrwnw 

a1wWw © 

to w bo o to to 

sae COs 

ee¢ese0 
& & 


oo w 





SS tb 
oe 


b 





2 to bt 
ao @ 


bo to te te 


mS Ww or ow 


2 to 














Re 
to © to © 9 to 
POT SOW 
Kaeo 


Seesss 


oan 


>So90 


BRERES 


o-lo 


bo bo to ts bl te 
an 


bo bo w& bo ty te 
aSawawacn 


FSRSSS 


to to to te 
CARD 


2 


@ 

















11-595 


11-611 


11-612 


11-614 


11-632 


11-683 


11-691 


11-692 


11-694 


11-714 


| 11-719 


| 11-742 


| 11-761 


11-767 


11-774 


11-779 
11-795 


11-855 


11-862 


11-881 


11-884 


11-924 
11-943 
11-956 

















bo bo bo bo be be 
“10 GS oor or 

















RaupH ALLAN BRADLEY 535 








ir, Urs Ur, =Zrs| Pi Pe Ps Me Ps B, P, ir, Ur, Urs Ure Urs) Pi P2 Ps Me Ps B, P 

















bo bo bo be 
sIwoacacn co 


to bo 





bo bo bo bo be 
o> > 


a > 





11-967 | -0091 24 29 29 34 34 ad *18.-18 -67 -07 


27 27 32 37] -28 -28 -28 -11 -04 26 26 31 31 36 34 -34 -14 +14 -05 Re esd 

28 30 32 36) -49 -22 -15 -10 -05 | 11-986] -0093] 25 26 32 33 34] -40 -33 -11 -09 -07 12-437 | -0225 

27 31 33 35) +48 -26 -12 -08 -06 12-007] -0098 26 27 28 34 35] +34 -28 -23 -08 -06 

27 29 33 36| -41 -27 -19 -09 -05 23 31 31 31 34] -58 -12 -12 -12 -0 12-438 | -0227 
26 29 29 29 37] -35 -20 -20 -20 -04 


oat | 12441 | -0233 
12-065 | -0104/ 25 27 30 33 35] -41 -27 -16 -09 -06 | 12-509] -0241 
0 


25 26 33 33 33| -40 -33 -09 -09 -09 
27 32 32 35| -48 -26 -10 -10 -06)|,,. ; \ 12-518 | -0244 
28 28 33 36| -41 -23 -23 -09 -o5/| 12°088| “0107/27 27 27 34 35] -29 -29 -29 -08 -06 
23 30 32 32 33] -59 -14 -10 -10 -08)|,,. ; 

27 31 34 34 | -48 +26 -12 -07 -07)) 19.994! .o111| 27 28 28 30 37| +29 -25 -25 -17 oat AP CN? | POR 
aS iD SS eh St St ee 24 29 30 32 35] -49 -18 -15 -11 -06 oe |“ pamh 

e -5AP| .- 
30 31 31 35] -58 -14 +11 -11 a 12:114| -0114| 25 28 30 31 36| -42 -23 -16 -14 at ve , 
29 29 30 37 ‘41 -19 -19 -16 -04 24 28 31 33 34 49 -22 -13 -09 -07 ‘abe 0238 
29 31 33 34/ -58 “16 -11 -08 -061| 15104] .910)| 26 27 20 32 36| .35 -29 -20 12 -o5}| 1272| -02 
27 29 31 37] +34 -28 -20 -14 -04 


25 27 30 34 34] -41 -28 -16 -08 -08)| 1,504) ooo 
26 31 33 35) -40 -33 -13 -09 -06)| 1, 16] 10g] 26 26 30 33 35| -34 16 -09 ‘ct ft jae 
27 29 34 35! -41 -27 -19 -07 -o6f|** “| 23 31 31 32 33] -59 +12 -12 10 -08\| 15 596) cosog 
30 30 33 34| -58 -14 -14 -08 a 12-203 | -0132| 27 28 29 29 37] -30 -25 -21 -21 -04 
27 30 30 37| -35 -29 -17 -17 -o4f)**"" 24 29 31 31 35] -49 +19 +13 +13 -06)| J5.¢45| 0374 
29 32 32 34| -58 +16 -09 -09 -06)! 1.4931 13g] 25 29 29 31 36] -42 -20 -20 -14 05} | ert | 
283 28 31 37| -35 -24 -24 -14 -oaf|'°" | 
24 28 32 32 34] -49 -22 -11 -11 =~ ‘a 
Saad ; , 12-651 | -0324 
20 20/88 96) 2 18 15 TS 05.1888) Oe cal ee —~ 
28 30 33 35] -49 -22 -15 -09 -06 Seaie! ; hie s a ee eS 2. é 
27 90°S3 261 21 27 48 -1 ot 12-248 | -0149] 25 28 29 33 35| -42 -23 -19 -10 cat ae cc Pad 
27 32 33 34| -48 -26 -10 -09 4 ann heMben |. mo - $8 = 4 bey 12-674} -0348 
27 28 33 36| -34 -28 -23 -09 -o5f| ‘~~ m0 | 28 28 29 37) +25 +25 -25 -21 -04 
26 26 30 34 34] -34 -34 -16 -08 -08 | 12-679| -0351 
26 32 32 35| -40 -33 -11 -11 -06)|,, ,. whe " 
24 30 30 31 35] -49 -16 -16 -13 
28 28 34 35| -41 -23 -23 .07 .06f| 12260] -0163 Sees che 1 Oe|| 12-716 | -0363 
26 31 34 34| -40 -33 -13 -07 -07\|,,, 24 29 30 33 34| -49 -19 -16 08 
26 29 34 35| -34 -34 -19 -08 -06f| 17274) “O167) 28 20 SD MS 5 80 17 da eet W270? | “ose? 
29 32 33 33) -58 -16 -10 -08 -08\| 4.584] 9170] - 
27 28 31 37) -20 -29 24 «14 -04f) " ” “| 24 28 32 33 33] -49 -22 -11 -09 -09 sai call 
‘127 27 28 32 36] -29 -29 -24 -12 -05 
30 30 30 36| -49 -15 -15 -15 -05 | 12-302] -0173] 95 98 99 34 34] -41 23 -19 -08 -08 19-780 | ©6412 
29 29 33 35 | -49 -18 -18 -09 -06)| 1,557] oi7g| 26 26 31 32 35] -34 -34 -14 -12 -06 
27 31 31 36| -41 -28 -13 -13 -05f| °"°* 25 : 
28 30 34 34| -49 -22 -15 -07 <9, 12-334] -0183] 26 27 29 33 35] -35 -29 -20 -10 12-831) +0441 
26 30 32 36| -34 -34 -16 -11 -05f|*~ 
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y 08 9. ‘ 
27 33 33 33| -48 -26 -09 -09 -09}| 1, 556] o1gs| 26 28 29 31 36] -35 -24 -20 -14 -05f| 17882) -O474 
27 27 33 36| -28 -28 -28 -o9 -o5f| !2 25 28 30 32 35] -42 -23 -17 -12 -07 | 19-898| -0491 
30 31 32 34| -58 -14 -12 -10 -07 25 27 32 32 34] -41 -28 -11 -11 -08)|,,.. c 
28 29 30 37| -35 -24 -20 -17 oat 12-360 | -0196) 96 98 28 33 35] -35 -24 -24 -10 -o7f| 12909) -0508 
28 31 32 35| -49 -22 -13 -11 -06\|,,. ong | 26 26 31 33 34] -34 -34 -14 -10°-08)/,0 0 | 
28 29 32 36| -41 -23 -19 -11 a5} | 12-406 02091 96 27 29 34 34] -35 -29 -20 -08 -ogf| 12915) -0526 
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536 Rank analysis of incomplete block designs 
Er, Ur, Ur, Ur, Us| Py Pa Ps Pa Ps B, a ir, Ur, Ur, Ur, ir, Pr Pa Ps % B, Z 
n= 65 (cont.) n=65 (cont.) 
30 32 50 +16 +16 +11 -08 25 29 30 33 33| -42 -20 -17 -10 - 
30 30 35 -25 -17 -17 -06f| 17-958} “05451 57 97 30 31 35] -30 -30 -18 «15 -o7f| {> 449) °1970 
31 33 50 +19 +13 -09 -09 26 27 31 33 33| -35 -29 -15 -10 - ' 
29 31 30 +30 +21 -15 on 12-961) -0565} 97 97 29 33 34| -30 -30 -21 <1 vi had Bie 
31 31 +42 +24 +14 +14 -07 25 30 30 31 34| -42 -17 -17 -165 - 
29 32 42 -20 -20 +12 a 12-974 -05851 96 29 30 30 35| -36 -21 -18 -18 -o7f| 12 513| -1495 
32 33 41 -28 +12 +10 -10 26 27 32 32 33|- 35 -29 -12 -12 
28 33 29 +29 -24 +10 nt 12-988| -0605/ 97 28 28 33 34| -30 -25 -25 -11 ee ae 
32 32 34 -34 +12 +12 -08 25 29 31 32 33| -42 -20 -15 -12 - 
28 34 35 +24 -24 -08 os 12-993) -0616] 97 28 29 31 35| -30 -25 -21 -15 -o7f| 19593) -1707 
; 26 28 30 32 34| -36 -25 -18 -13 -09 | 13-601| -1781 
20 30 36| .36 -21 21 .17 og} | 12084 | -0098 
25 30 30 32 33| -43 -17 -17 -12 
30 33 50 -16 +16 -09 -09 27 28 30 30 35/ -31 -26 -18 -18 - sadead Wheat. 
30 30 30 -30 -18. +18 oe 13-037 | -0650) 25 29 32 32 32| -43 -21 -12 -12 - iseea| ten 
32 32 50 -19 -1ll -1l -09 28 28 28 31 35| -26 -26 -26 -15 - 
28 31 30 +25 +25 +15 pe 13-038 | -0673) 26 28 31 31 34| -36 -25 -15 -15 - icexa| eal 
a a a a 26 29 29 32 34| -36 -21 -21 -13 - 
30 33 42 -24 +17 +10 m1 oe aoe | ti ae 
30 32 35 -29 -17 +12 -07 
26 28 30 33 33| -36 -25 -18 -1l ee 
‘ } 13-073 | -0733/ 25 30 31 31 33| -43 -17 -15 -165 - ’ 
28 34 29 -29 -25 -08 -08 13-740 | -2171 
30 31 42 -20 -17 -14 -07 |13-126| -0761| 27 29 29 30 35) -31 -22 -22 -18 
29 33 42 -20 +20 +10 -08}| 1. 137! org - = 29 = _ ~ = = = “IT\) 13.753) -2222 
31 31 35 -29 -14 +14 -07 7 27 31 31 34 
27 27 30 33 33| -30 -30 +18 -11 13-757| -2248 
eve aS ee oat 13-189} -0852| 25 30 31 32 32| -43 -18 -15 12 -12)| 15.915! oggg 
30 30 42 +17 -17 -17 -07 |13-201| -0857| 22 28 29 30 35) -26 -26 -22 -19 - 
26 29 30 31 34| -36 -21 -18 -15 -o9 | 13-822] -2485 
31 32 42-24 +14 -12 -08)! 15.5141 -o903 BR: 
29 32 35 +26 -21 -12 -o7f| ‘214 ed ees nee | ee ‘13 11) 13-828 | -2725 
27 28 29 32 34| -31 -26 -22 -13 - 
go ba) ag a ay a a |i9205| ntl ay ax a ae] as as 38 8 221 spp am 
rp ae ian deg Se ost 13-264| -0969| 28 29 29 29 35| -26 -22 -22 -22 
HW as te Ae See at 26 30 30 30 34| -36 -18 -18 -18 -09 | 13-895| -2794 
ee a 13-265| -0982| 26 28 32 32 32! -36 -25 -13 -13 , ; 
28 30 25 -25 -25 +18 oa} onan ae oa cat (a Ae Ma Ak oot] teOen| 7000 
oh $2 32) 22 24 24 10 20) snag/ aom|27 27 9 32 98) 20 90 15 18 11 5095) se 
31 32 50 -14 -}4 -1l at 26 29 30 32 33 +86 -22 -18 -13 
eee 13-340| +1042 
- . a 2 2 27 28 30 31 34| -31 -26 -18 -16 -ogf| 1974) °3310 
"42 20 +17 +12 -08 27 27 32 32 32| -30 -30 -13 -13 
13-364 | -1133 esi 
30 31 36 +25 -18 -15 orf 28 28 28 33 33| -26 -26 -26 -1l 18-980 | 3338 
° . “39 . . . . . . . 
26 32 35| 20 25 .25 1g or}| 22200) -la70] 20 39 3) ot oe | at az ae to .oo}|1#047| -B520 
31 32 +35 +29 -15 +12 -09 2 31 37 +18 -18 -16 
29 33 36-25 -21 -10 oo} 13-376] -1272] 97 99 30 30.34 ‘81 -22 -19 -19 -ogf| #219) °3751 
31 31 42 +20 -14 -14 >) 13-430 | -1395] 26 29 31 32 32| -37 -22 -16 “13 -13)| 141011 .go75 
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Er, Ur, Urs Ur, Urg| Py Pa Ps Me Pz B, r Zr, Ur, Ur, Ure Urs} Py Py. Ps Pe Ps B, P 
n= 5 (cont.) n= 5 (cont.) 
97 28 30 32 33| -31 -26 -19 -13 -11 |14-125| -4200| 28 28 30 32 32| -27 -27 -19 -14 -14 |14-487| -6677 
26 30 30 32 32| -37 -18 -18 -13 -13 27 30 30 31 32| -32 -19 -19 -16 -14 
28 28 30 30 34] -26 -26 -19 -19 = 14193) +4330) 53 29 30 30 33] -27 -23 -19 -19 -1uf| 14557) -7239 
27 28 31 31 33] -31 -26 -16 -16 -11 28 28 31 31 32| -27 -27 -16 -16 -14 
27 29 29 32 33| -31 -22 -22 -13 at 14197) +4593] 95 99 99 32 32| -27 -23 -23 -14 fs 14-660 -7531 
2 e e e . e ° 
26 on og | coy 29 :16 “16 -18}) 14.965! -4896] 27 30 31 31 31] -82 -19 -16 -16 -16 
28 29 29 30 34| -27 -22 -22 -19 -10 14-628 | -7739 
27 28 31 32 32| -31 -26 -16 -13 -13 20° 2939 0 38) -38 “28-38 -19 +18 
14:271| -5203] 28 29 30 31 32] -27 -23 -19 -17 -14 | 14-7001 -8501 

98 28 29 32 33] -26 -26 -22 -14 -11 
28 30 30 30 32] -27 -20 -20 -20 -14 |14-771| -8649 
26 31 31 31 31| -37 -16 -16 -16 -16 
3 29 29 29 34| 23 28 28 08 1ot| 14387| -Sa32| 28 29 81 31 31] -27 -23 «17 -17 ay et eo 

a 29 29 29 31 32| -23 -23 -23 -17 -14 
27 29 30 31 33| -831 -22 -19 -16 -11 | 14-341) -5588 
27 30 30 30 33| -31 -19 -19 -19 -12 | 14-412| -5657]28 30 30 31 31] -27 -20 -20 -17 a watiadh eos 
27 29 30 32 32/ -81 -22 -19 -14 My 14-414| -6072| 29 29 30 30 32| -23 -23 -20 -20 -14 
28 28 30 31 33| -27 -27 -19 -16 -12 29 29 30 31 31] -23 -23 -20 -17 -17 |14-912| -9756 
27 29 31 $1 32| -31 -22 -16 -16 -14\| 1, 456! gsc] 29 30 30 30 31| -23 -20 -20 -20 -17 |14-982| -9987 
28 29 29 31 33| -27 -23 -23 -16 -12 30 30 30 30 30] -20 -20 -20 -20 -20 | 15-052| 1-0000 














[ 538 ] 


MISCELLANEA 


Approximate formulae for the percentage points and the probability integral 
of the non-central x? distribution 


By 8. H. ABDEL-ATY 
University College, London 


1. The non-central x? with f degrees of freedom and the parameter A has a probability-density 
function which may be written as 


(y e-ix™ e-4A © (y’2)i+I-1 JI 
PS Bi smo BT +H)” 
the sth cumulant being K, = 28-1(s—1)!(f+eA). 


Some exact values for the probability integral have been given by R. A. Fisher (1928) and by F. Garwood 
(1934). Tables for use in connexion with the power function of x* have been computed by E. Fix (1949), 
and several methods of approximation were considered by P. B. Patnaik (1949). It seemed of interest 
to investigate the possibility of another type of approximation based on normalizing the y’* distribution 
by means of the cube-root transformation, and thus achieve a rapid method of calculating the probability 
integral or percentage point when the value required was not already tabulated. The cube-root trans- 
formation of Wilson and Hilfertz is so very useful for the central y* that it would not be surprising to 
find it equally useful in the non-central case. 





2 \h 
2. We make the transformation y= ( x ) , 
f+a 
writin r=f+A and b 2 
1 = =—, 
Far 


we find after expansion that h = 4 is the appropriate value to choose for minimizing the coefficient of 
r-2 in K,(y) and reducing the higher cumulants, x,(y) for s> 2, to a minimum. 
The moments of y were obtained generally. When h is put equal to 4 we have approximately 


2 40 80 
Ky(y) = 1 gr +0) — gp rt + 78 (1 + 3b + 330% — 776%) 


176 
+ gp 71(1 + 4b — 2106# + 238088 — 29754) + O(r-4), 


2 16 8 
k(y) = a” 1+6)+ 38 7-26? — 3 r-3(13 + 396 + 4056? — 10256*) 
160 
— ge 71+ 4b — 876% + 116858 — 154404) + O(r-4), 
8 32 

k;(y¥) = — zs” +35 r~-3(1 + 3b + 216? — 626°) 

32 

+ 38 r—4(8 + 326 — 1776? + 4550b* — 6625b*) + O(r-5), 


16 256 
Rly) = — yp 7-91 + 8b + 126 — 4468) — > r-4 (1 + 4b + 6b" + 27408 — 4585") + O(r-), 


128 
Rely) = a7 -(1 + 4b + 156* + 13065 — 26064) + O(r-). 


Measures of skewness and kurtosis are 











8b¢ 641+. 4b + 246741693504) 128 1 
Aly) = pos r(1+0)8 3%(1+5)5 (5): 

_ 4 (14+3b+12b*— 4469) 64 (1 +56 +762 + 27168 — 22064 — 32605) 
Aly) = 3-3, — r(1 +6)? - r(1+5)8 , 








—_ 
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These values for #, and £, may be compared with the following values for y’*, noting that 0<b<1: 


my _, 8(1 +26)? 12(1 + 3b) 
Pe) = + oF r(L+b) 


They indicate that the distribution of (y’?/r)t tends to normality more rapidly than that of y’*. 
As a first approximation we take (’*/r)t to be approximately normally distributed about a mean 
1 —§(1+6)/r with variance 3(1+)/r. We shall refer to this as the ‘first approx.’ in the numerical results. 
3. The Fisher-Cornish (1937) expansion for the standardized deviate of a variable can be used with 
advantage in our case, since the effect of the cube-root transformation is to make the transformed 
variable approximately normally distributed. 


ig = {y— Ki(y)}/JfKa(y)}, 


and £,(x) = 3+ 


Writing 
then the 100a % point of Y is given by 
¥ = —r-(1+6)-96*B, ,—r-(1+)-* (LB, , + O*By 2) + 7-1 +6)-# (MB, , + NB, .— Lb*B, y—6°B, 4), 


a +... [pean 
V(2m) J ¢ 
L, M and N are the polynomials in b given by 
ZT = (1+6)(1+3b + 126? — 4463), 
M = (1+b)?(1+46 + 24b? — 416? — 3504), 
N = (1+6)?(1+ 4b + 156? + 1306 — 26064), 
and the B’s are the following polynomials in €: 


where 


/2 
= we (e5 
By 3 (g 1), 
By, = ga(é* — 36), By, = 3(2&? — 5), 
= 4/2 2 aif 2/2 4 2 
Bs.y ann 81 (€ —I); Bs.3 — 405 (& 6g +3), 
/ 
Bas = So (E5642), By. = “4 (19g 536e4 19), 


These polynomials are tabulated for some values of « in Table 1. The probability integral F(Y) up to 
@ given point can be obtained by a straightforward application of the Edgeworth expansion, thus giving 
mt il /2 
KY) = —3* gf — r-4(1 + b)-2b?H, + Apr-(1 + 6) -3 (LH, — 6b*H 
(Y) i= u+ 3° (1+) at+gar—(1+6)-*( 3 5) 

- v2 r-4(1+b)-*(40MH, + 4NH, + 5Lb?H, — 106°H,) . ee), 

810 : ° ®'} WV(27) 
where the H’s are the Hermite’s polynomials in Y; L, M and N are the same polynomials in 6 as given 
above. 

In the numerical results, we shall refer to results given by formulae of thissectionas the ‘closer approx.’. 











Table 1. Giving the B-polynomials for some values of « 


























@ g By By. By .s Bs 1 Bs. Bs:5 Bs.4 
| 
0-5 0-00000 | —0-47140 0-00000 0-00000 | — 0-06984 0-02095 0-10476 1-18724 
0-4 | 0-25335 | —0-44115 | —0-01377 | —0-27427 | —0-06536 0-01829 0-08816 0-95311 
O-3 | 0-52440 | —0-34177 | —0-02646 | —0-51857 | —0-05063 0-00996 0-03670 0-23275 
0-2 | 0-84162 | —0-13750 | —0-03572 | —0-67018 | —0-02037 | —0-00523 | —0-05447 | —1-01408 
0-1 | 1-28155 | 0-30282 | —0-03222 | —0-48849 0-04486 | —0-02903 | —0-18408 | — 2-63128 
| | 
0-05 | 164485 0-80400 | —0-00897 0-15025 0-11911 | —0-04130 | —0-22040 | — 2-69255 
0-01 | 2-32635| °2-07979 0-10391 3-01071 | -0-30812 | —0-00128 0-22152 5-70110 
0-005 | 2°57583 | 2-65632 0-17339 4-73369 0-39353 0-05037 0-67292 | 13-52149 
0-001 | 3-09022 4-03026 0-37480 9-68195 0-59708 0-25767 2-38033 | 42-26471 
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4. Tables 2 and 3 give the percentage points and the probability integral for the x”? distribution as 
calculated by the first approximation and by the closer approximation. For sake of comparison we have 
quoted the corresponding values obtained by Patnaik (1949) using a y? distribution. It will be seen that 
even for small degrees of freedom and moderate values of A the expansion agrees very well with the 
exact value. In general, the results using the first approximation are of about the same accuracy as those 
obtained by Patnaik’s central y? fit, which is to be expected in view of the properties of the Wilson- 
Hilferty transformation. Patnaik also considered an approximation based on applying the Fisher- 
Cornish technique directly to y’?; our results have been more successful because we have applied it to 
(x’2)4, i.e. to a variable more nearly normally distributed to start with. 


Table 2. Percentage points of the x’*-distribution 











Upper 5% point Lower 5% point 
7 A 
First Closer First Closer 
x? fit approx. | approx. Exact x fit approx. | approx. Exact 
2 l 8-63 8-56 8-38 8-642 0-20 0-17 0-171 0-168 
4 14-72 14-66 14-62 14-641 0-94 0-89 0-643 0-646 
16 33-35 33-32 33-08 33-054 6-89 6°87 6-320 6-322 
25 45-66 45-64 45-33 45-308 12-68 12-67 12-077 12-080 
4 1 11-72 11-67 11-67 11-707 0-93 0-91 0-908 0-909 
4 17-38 17°34 17-27 17-309 1-95 1:93 1-766 1-765 
16 35-69 35-66 35-44 35-427 8-36 8°35 7-885 7-884 
25 47-94 47-91 47-62 47-613 14-26 14-26 13-732 13-733 
7 1 16-01 15-98 15-99 16-004 2-51 2-49 2-494 2-494 
4 21-28 21-25 21-21 21-228 3-78 3-76 3-665 3-664 





16 39-16 39-16 38-96 38-970 10-64 10-63 10-256 10-257 
25 51-34 51-33 51-06 51-061 16-68 16-67 16-227 16-226 



































2 
Table 3. Probability integral i p(x?) dx” 
0 











| 
, First Closer 
f A x" x* fit approx. approx. Exact 
4 4 10-00 0-7191 0-7198 0-7123 0-7118 
4 4 24-00 0-9913 0-9911 0-9925 0-:9925 
7 16 24-00 0-5947 0-5947 0-5894 0-5898 
7 16 38-97 0-9482 0-9484 0-9500 0-9500 
a 8 20-00 0-3380 0°3374 0-3368 0-3369 
16 8 40-00 0-9626 0-9626 0-9632 0-9632 


























My thanks are due to Dr F. N. David whose suggestions helped considerably in the presentation of 
this paper. 
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Moments of the mean deviation 


By A. R. KAMAT 
Fergusson College, Poona, India 


In an earlier paper (Kamat, 1953) I have derived formulae for bivariate and trivariate absolute moments 
of correlated normal variates. As a direct application of these results, one may derive the moments of 
the mean deviation in samples of size n from a normal population. Thus if 


n 
m= 2 |x,—-%|/n, 
i=1 


and we write z, = x,—2, then the z; are normal variates having zero expectation, variance o*(n —1)/n 
and correlations p = p(z;,2;) = —1/(n—1) (¢+)). 

Using the exact results of § 2-6 of my earlier paper and, for &(| z,;z;z,z,|), the expansion in a power 
series given in § 3, the first four moments of m can be derived, the last involving an expansion in inverse 
powers of n — 1. The values of the first two moments are of course well known, while Geary’s work (1936), 
led to expansions for the third and fourth moment quoted by Pearson (1945).* 

Prof. Pearson and Dr Hartley have, however, suggested that I should put the following results on 
record as they were used in an investigation into the accuracy of values for the beta coefficients for low n, 
quoted ix. Table 20 of their revised (1954) Biometrika Tables for Statisticians. 


(a) Third moment of m 


This cen be expressed exactly as follows: 


ore 2 eo Bin— 2) Le 

= LC) tata GN ESC) Bate 
3(n— 1) 1 \ Meas 

bt er 0-5) -3 sin — i}. (1) 


(b) Fourth moment of m 


fy _ =) | 3(n ?—n+2) =| eee 1 ) 6(n? — 3n+4) eat 1 
=( n(n—1) mL n(n—1) (n—1)? 


nin—l) n—1 
mn? —10n + 16 2\2 [6(n—1) 1 \} 4(n — 2) A 
~ n\(n—1) *|+(2) [ n (1-2 *5) Seyi (; a 














n 














. 1 — 12(n—2) 1 (n—1)(n—2)(n—3) 
Fill no ee Al}, 
—— n—1 n%(n—1) ~ n—3" n® ] 
where 
A = 14+3(n—1)-?—4(n—1)-3+-(n—1)-4 4 4(n— 1) + (mn — 1)-8 + 48 (n — 1)-7 + BB (n— 1) F+.... (2) 


The series involved in (2), while different in form from that given by Geary, which he obtained by direct 
integration, is asymptotically equivalent. 

Table 1 gives numerical values of the #, and f, coefficients of the mean deviation for sample sizes 
n = 3, 4, 5 and 6 calculated: 

(a) From equations (1) and (2) above. 

(6) From the Geary expansions (3) and (4) of Biometrika, 33, 252 (1945) with Godwin’s (1948) 
correction. 

(c) By numerical quadrature of Godwin & Hartley’s (1945) table of the probability integral of m. 

Our values for /, (i.e. those given under (a)) may be taken as correct values since they are obtained 
from the exact formula for 4, given above. The values obtained from Geary’s expansion for , agree with 
them for n> 4. In the case of f,, the value for n = 3 given-by us is exact, since the formula for 4, in this 
case is free of the expansion for &(| z,z;z,2,|). For n = 4, the value of £, = 3-252 obtained from Geary’s 
expansion coincides with that calculated from the exact formula obtained from the distribution given 


* A correction to the last term in the expression for A, = 4,—3y3 was noted by Godwin (1948). 
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by Fisher (1920).* We may conclude that in the case of n = 5, also, the value of £, obtained from Geary’s 
expansion is to be preferred to that ubtained by using the expression for yz, given in (2). From n = 6 
onwards the two formulae give identical values for £,. Geary’s expansion for A, is given up to the term 
in (n—1)~ and it seems at first sight paradoxical that it should provide a better approximation than 
the formula (2) for 4, which contains a series expanded up to (nm — 1)-*. The result may, however, be due 
to the expansion of all other terms in A, = 4, — 32 in inverse powers of (n — 1) which probably corrects 
the error involved in the use of the series for (| 2;2;2,2;|). 


Table 1. Comparison of £,, 8, obtained by different methods described abovet 





























n 3 4 5 6 
A, (a) formula (1) 0-417 0-298 0-230 0-187 
(b) Geary’s expansion — 0-299 0-230 0-187 
(c) quadrature 0-418 0-298 0-229 0-186 
fz (a) formula (2) 3-286 3-243 3-195 3-161 
(b) Geary’s expansion —_ 3-252 3-197 3-161 
(c) quadrature 3-286 3-251 3-196 3-159 
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On the relation between estimating efficiency and the power of tests 


By R. M. SUNDRUM 
University of Rangoon and Institute of Statistics, University of North Carolinat 


It appears to be generally assumed that a statistic which has a high efficiency in estimating an unknown 
parameter also gives a powerful test of hypotheses about that parameter. For example, a common 
criterion for comparing distribution-free tests with corresponding distributional tests and with other 
distribution-free tests is the asymptotic relative efficiency first proposed by Pitman (1948). Recently, 
Stuart (1954) has shown that this is equivalent to using the estimating efficiency of these statistics to 
compare their performance when used in tests of significance. In fact, it was by this argument that this 
measure of efficiency was earlier arrived at by Hotelling & Pabst (1936) in their study of the Spearman 
rank correlation coefficient and by Cochran (1937) in his study of two tests of the mean and of the 
correlation coefficient of normally distributed variables. In this note, we derive a condition for the 
validity of this assumption in the case when the statistics have normal distributions, a case for which 
the idea of estimating efficiency has most relevance. 


* Forn = 4 the expression for 4, derived by Fisher is the same as given in our equation (1) above, but, 
as pointed out by Cadwell (1953, p. 342), a correction is needed in Fisher’s expression for the fourth 
moment; the necessary alteration gives a correct value of 8, = 3-252. 

+ I am indebted to Miss May and Mr Ablewhite of the Department of Statistics, University College, 
London, for some of the computations in this connexion. 

} This research was supported by the United States Air Force, through the Office of Scientific Research 
of the Air Research and Development Command. 
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Let ¢, and ¢, be two statistics which are normally distributed, unbiased estimators of a population 
parameter @ with variances o7(0,) and o3(9,) respectively under the null hypothesis H,: 0 = 0,; and 
oi(@,) and o}(@,) respectively under the alternative hypothesis H,: 0 = 0,>0,. Let 73(0,)<03(0,), 
o3(9,) <o3(9,), the inequality holding at least once, so that t, may be called the more efficient estimator. 


1 @o 
If A, is defined by M(A,) = “cass | e-*"* dy = a, 
a @) = 2m) ) nw. y 
the one-sided critical region of size « based on ¢, is given by 
ty > Og +A,71(9o), (1) 
and for t, by te >Oy +A, 72(4). (2) 
The power of the critical region (1) is then 
Og +A,o1(O5) —8 
P, = of 07 07140 | 3 
F o,(9;) : @) 
and of the critical region (2) is Pes eer ee : (4) 
7,(9;) 


As (zx) is a monotonically decreasing function of x, the test based on ¢, (the more efficient estimator) 

i ful if 

ae eee A,—9, +A, 71(9o) a“ A,—9, +A, 72(9o) 
o,(9;) o,(9;) 





, (5) 











a 7 1(9o) 7 (1) — (Io) 719) _ V,-—Vo 
sit falar A, o,(0,)—7,(9;) st Aal V,-1 7(9e) 
where Vi= ae (¢= 1,2). 


If V.> V,, then the right-hand side of (5) is less than or equal to 0 and the inequality is satisfied. 
But if V, > V,>1, so that the relative efficiency of t, is greater under the alternative than under the null 
Vi, i Vo 
V,-1 
applications, A, is always positive and can be chosen so large that 





hypothesis, then ( ) >0. As a, the size of the critical region is always taken less than } in practical 


V,-V, 

rm = :) 7(9) > 9, —9% 
1 

and the inequality (5) is reversed. 

However, this possibility is not very important in practice. For if A, is chosen so as to reverse the 
inequality (5), the power of the test will be reduced very much. In fact under the special assumptions 
of the above argument, the situation in which the more efficient estimator gives a less powerful test 
cannot arise, if the levei of significance is chosen so as to make the power of that test greater than }. 
This can be seen as follows: 








P, = o(2etAecre os) >} = (0) 
if 45-6, +A, 0;(8) <0, 
i.e. if (8,—45) >A, 7(o). (6) 
From the condition V, > V,>1, we have ; 
0 ViaVo <1. (7) 
V,-1 


From (6) and (7) the inequality (5) follows. 

The argument of this note helps to explain the fact mentioned by Fisher (1950, pp. 314-15) that good 
tests may be based on inefficient estimators. He gives an example from genetics concerning a test for 
linkage in inheritance of two factors. Given the frequencies of four combinations in a sample as a, b, c 


and d with a+b+c+d=n (8) 


and the corresponding probabilities of occurrence as 


#(2+9), 1-6), 21-4), 26, 
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the problem is one of estimating 9, when ,/@ is the recombination ratio. The maximum likelihood method 
gives a statistic ¢, as the positive solution of the equation 


n6* —(a—2b—2c—d)0—2d = 0 (9) 
201 — 
with a sampling variance o%(t,) = Se (10) 
Another statistic ¢, may be defined by 
a—b—c+5d 
fue 11 
te on (11) 
with expectation 0 and sampling variance 
1+60—40? 
2(¢,.) = ———_——__.. 12 
o*(ts) — (12) 


It is easily verified that o*(t,) <o*(t,). 
Now consider a test of Hy: 0 = } (no linkage) against H,: 0 = 0,>}. We find V, = 1 so that, assuming 
n large enough for a normal approximation to hold satisfactorily for the distributions of ¢, and ¢,, and 


for the bias of the maximum likelihood estimator to be negligible, the inequality (5) is reversed for all 
0, satisfying 





3A, 
(-d< Te. (13) 
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The interpretation of negative components of variance 


By J. A. NELDER 
National Vegetable Research Station 


1. InTRODUCTION 


It not infrequently happens in split-plot.experiments that the error mean square for main plots is less 
than the error mean square for subplots. Under the normal model the expected value of the error mean 
square for main plots is ¢*+r0’*, and for subplots, 7*, where o* is the subplot component of error, o”* 
is the main plot component of error, and 7 is the number of subplots in each main plot. Thus, if this model 
holds, the main plot error in an experiment can only be less than the subplot error by sampling devia- 
tions. This fact seems to have led expositors of the analysis of variance to recommend that when the 
main-plot error is less than the subplot error in an analysis, o’* should be taken as zero, and the two errors 
should be bulked. On the randomization model, however, there is no reason why the main-plot error 
should not be less than the subplot error in expected value as well as in any particular experimental 
analysis. Furthermore, an unbiased estimate of variance of treatment differences is obtained by using 
the usual formulae as though o”* were negative. This note will present a modified form of the normal 
model, originally due to F. J. Anscombe (unpublished lecture notes), which has a closer affinity to the 
randomization model than the customary normal model, and in which negative components of variance 
can appear and be given a satisfactory interpretation. We cor sider first the randomized blocks type of 
experiment. The argument was outlined by Anscombe (1948) .n a contribution to the discussion of a 
paper by Champernowne. 


2. RANDOMIZED BLOCKS 


Consider a set of fixed numbers x,, (i = 1,...,7;7 = 1,...,¢), where x, is the datum from the jth plot in 
the ith block. From these numbers form a set of random variables y,, as follows: choose a block at random 
and reorder its members at random to give 1, Yia» «++» Ys; Tepeat the procedure with one of the remaining 











J 
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blocks chosen at random to give 1, ..., Ys, and so on. The distribution of the y’s has the following first- 
and second-order moments [summation is over all combinations of suffixes except those indicated]: 


‘’ 


1 
Mly) == Bry= ph, n= rt, 
ee . 
var (y) = 7 ute = 0%, 


COV (Yio Yr) = atin i =p,o* (j+)), 
aa 


aes Hi 
n(t—1) 


1 
= 6 -4= 2 ; " 
COV (Yass Yur) ir—1) orate f=p,o* (t+k) 


Suppose now that the distribution of the y’s can be approximated to by the multivariate normal dis- 
tribution with the same first- and second-order moments; then the cumulant generating function of the 
distribution will be ; 


o 
V(t) = BUtyt yeas + 2p, ZB bist t+ 2g DX tystys] 
j#l i#k 
o? o2 - o? : 
5 (1 —/p,) Luts (P1— Ps) E(Dea+| o Btu F ota? | . 
t 


Thus we ean write Yas = M+], + Cys, 
where E(m) = 4, var(m) = p,o?, 
E(b;) = 0, var(b,) = (p;— Ps) 0, 
E(é4) = 0, var(e;) = (1—p,) 0%, 
and the m, 6; and e,,; are all independent normal variables. The randomization distribution imposes 
restrictions on p, and p,. We can, without loss of generality, put w = 0; then 
no{l+(t¢—1)p,] = Dayxzy_+ U2}, = X(L2,,)*>0, 
j#l ij 
nol +(t—1)p,+4(r—1) pg) = X (Lax)? + % weytu— (Dae) 
oe i# 
= (Lx)? —(Lx,s)* = 0. 


It follows from this that p, < 0. Thus the variance of m is negative, and the variance of b; may be negative, 
for it is possible to have p, <p,. The model y,; = m+ 6; + e,;, th 2refore, is to be understood as a shorthand 
way of expressing the multivariate distribution of the y’s. It is not difficult to show that the complete 
distribution is a valid one, i.e. that the variance matrix is positive-semi-definite. The variance matrix 
may be written 








Ea CMRLY sag Sepa. esc 
BS AS B 
V=c? : =o 3 
~ e 
|B Y RS 
where Ce Var eae 
Ai il py Pi 
A= . = (1—p,)I+p,J, 
: Be 
LPs Ai il. 








I being the unit matrix and J the matrix with all elements unity, and B = p,J. [A and B are both square 
matrices of order t.] Consider now | V—Ao*I|; by adding all rows together we find that 


(1+(¢—1)p,+&r—1)p,—A] 
35-2 
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is a factor. Subtracting any block of ¢ rows from any other we get [1 +(t—1)p,—7p,—A] as a factor and 
this may be obtained from r— 1 linearly independent operations. Finally, subtracting any row within 
a block from any other we have (! —p,—A) as a factor and this may be obtained from r(t— 1) linearly 
independent operations. Hence 
| V—Ao*l | = of] + (¢—1) p, +4(r— 1) py—A] [1 + (t— 1) p: —t— AY [1 =p, — A. 

Under randomization the first latent root is zero corresponding to the fact that var (Ly,;) = 0, the second 
repeated latent root equals — trp, >0 and the third is 1 —p, > 0. All the latent roots are thus non-negative 
and the distribution is a valid one, though degenerate in that the rank of V cannot exceed n — 1. The three 
distinct latent roots multiplied by o* give the expected values of the variance of the mean, the between- 
blocks mean square, and the within-blocks mean square respectively, while the number of repetitions 
of each root gives the degrees of freedom for each sum of squares. The expected mean square for blocks 
will be less than the expected mean square for within-blocks if 


1+(t—1)p,—tp,<1—p,, i.if py<pe. 


The possible values for p, and p, are shown in Fig. 1, together with the region where the block ‘com- 
ponent of variance’ is negative. 


3. SPLIT-PLOT EXPERIMENTS 


The situation in split-plot experiments is slightly more complicated, but not essentially different. Let 
Xz (t= 1,...,757 = 1,...,8; k = 1,...,¢) be the quantities from which the randomization distribution 
is supposed to be generated, where ;;, refers to the kth subplot in the jth main plot in the ith block. 
Let y,;, be the randomized variates produced from the randomization procedure. There are three 
different correlation coefficients between pairs of y’s according as they lie in the same main plot, in the 
same block but not in the same main plot, or in different blocks. Denote these by p,, p, and ps respec- 
tively. The first- and second-order moments of the distribution of the y’s are given by 


; 1 
Ayly) = a LH, =f, n=rat, 


var (y) = — Lain —p* = 0, 
o= aL pes x 
Pi = nt—l) hae EB’; 
pee Fem aa > a; Liye — pe? 
2 nt(s — 1) 543° tik is’ k ’ 


Pine ead ee 


By an obvious extension of the randomized block argument we have 
1+(t—1)p,20, 
1+(t—1)p,+#(s—1)p,>0, 
and 1+(t—1)p,+t(s—1) p,+ts(r—1) p, = 0. 


The scope of possible values for p, and p, is now considerably widened, as is shown in Fig. 2. Again the 
main-plot component of variance will be negative if p, <p,. 


4. COMPARISON OF THE MODELS 


The modified normal model presented above bears a closer relation to the randomization model than the 
orthodox normal model, in that its first- and second-order moments agree exactly with those of the 
randomization distribution. However, the analogy between the modified normal model and the random- 
ization model must not be carried too far; for example, the between-blocks and within-blocks sums of 
squares are constants in the randomization model, but are not so in the modified normal model. The two 
normal models are identical in many respects, except that the expression of a datum as the sum of several 
independent random variables is a formal one in the modified scheme, in that some of the variables may 
have negative variances. Many of the deductions from the orthodox normal model remain true with the 
modified one. For example, the F-distribution still holds for the treatments-error mean square ratio 
on the null hypothesis; this is because any two contrasts contributing to the within-blocks sum of 
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Fig. 1. Possible pairs of values for p, and p, in a randomized block experiment lie on the solid 


diagonal line. On the thickened part, the block component of variance is negative. 
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Fig. 2. Permissible values of p, and p, in split-plot experiments. Single shading: permissible area, 
main-plot component of variance positive. Double shading: permissible area, main-plot component 
of variance negative. 
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squares, which are independent and have equal variances on the orthodox normal model, remain so 
on the modified one. The main point to be noted is that neither on the randomization model nor on the 
modified normal model is there any justification for the common practice of putting equal to zero a 
variance component whose estimate from an analysis is negative. The appropriate formulae should be 
applied as though the component were negative and no special distinction should be made. 

If the model used in the analysis is the orthodox normal model, then the practice of equating negative 
components of variance to zero is much less objectionable, and not likely to lead to much bias in the 
estimation of standard errors, etc. In any particular situation, it is the statistician’s responsibility to 
decide which model is more appropriate. With field experiments in agriculture, for example, it is known 
that neighbouring plots tend to be positively correlated and that the correlation usually falls off with 
distance; this would imply that p, > p, in the notation of this paper, so that negative variance components 
would not occur. Such a conclusion is, however, a ‘large-sample’ one, becoming more and more likely 
to be true as the number of plots involved increases. An experiment involving only a small number of 
plots may well give p, <p, owing to deviations in the correlation pattern, and most statisticians dealing 
with such experiments have experience of cases where the main-plot error is significantly less than the 
split-plot error. This, surely, is as good evidence that p, <p, as a significantly higher main-plot error 
is that p, > po. 

In general the use of the orthodox normal model in randomized experiments implies an a priori 
assumption that p, >/,,and similar inequalities in more complex lay-outs. Situations may occur where 
such assumptions can be made with confidence, but it seems clear that frequently they cannot, with 
the result that the modified normal model must be used if it is required to justify the analysis of random- 
ized experiments by reference to a model based on normal variates. 
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The distribution of the regression coefficient in samples from a non-normal population 


By I. D. HILL 
Statistical Advisory Unit, Ministry of Supply 


1. INTRODUCTION 
Student’s ¢t-distribution enters into simple regression theory in two ways. If we write 
B=Ky/Ky and b= ky /kyo 
for the population regression coefficient of y on x and ite sample estimator respectively, then the com- 
monly used test of significance follows from the fact that 


=A) AZ (2-8) i0=8) = (ta an) {te 2 bn (1) 
© ME y= = bX (x, —#)%} Keg Kao] \(1—1*) koe 


is distributed as Student’s ¢ with n— 2 degrees of freedom. This result holds if the regression of y on x is 


linear and the distributions of y for given x are homoscedastic and normal. No restriction need here be 
placed on the distribution of x. 


1) Kao ky “) hoard 

eee tm.0-?) cwne aie 3 = Kao] \(1—p*) Kos s 
follows Student’s ¢-distribution with n—1 degrees of freedom. This result appears to be true only in 
samples from a bivariate normal population. 

The result (2) provides the distribution of the regression coefficient, b, but the statistic cannet be used 
in practice unless the values of the population variances and covariance are known. On the other hand, 
without this knowledge, the statistic (1) can be used to test whether an observed value of 6 differs 
significantly from zero or from a specified £, and to obtain confidence limits for £ given b. 

In this paper it will be considered how far departure from normality affects the distribution of 6, 
that is to say how far it modifies the significance levels that result from (2). The question of the modi- 
fication to levels derived from (1) will not be considered directly, although in so far as tests based on (2) 
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are not sensitive to departure from normality, it seems likely that tests based on (1) will also be 
insensitive. 

M. B. Cook (19516), using bivariate k-statistics, investigated the sampling moments of the regression 
coefficient under the very general assumption that the bivariate surface-generating the samples had as 
many cumulants as desired. The method used was to write the regression coefficient, k,,/k,o, in the form 


K. kK. Keo — Keo\ 
Ku (14 11 “) (1+ 20 *) ; 
Keo Ky Keo 


and to expand the third factor as a negative binomial. This expansion will be valid only if kyy< 2K go, 
but for reasonably large sample sizes, it can be expected that this condition will be satisfied in all but 
a small proportion of cases. 

Difficulties such as this with expansions can be avoided if we follow the technique developed by 
David & Johnson (1951) and, instead of finding the moments of b = k,,/k_9, examine the manner in which 
departure from normality in the parent distribution modifies the probability, 

P {ky 1/koq> 0} = P{ky, — chyo > 9}, (3) 
where c is an appropriate normal theory significance level for the regression coefficient derived from (2). 

If t, , is the upper 100% percentage point of Student’s distribution having v degrees of freedom, it 

follows from (2) that the value of c to be used is 
© = {Ky +bn—1,0(K 20K oa — K4y)#/(m — 1)A}/Kao. (4) 

Writing v = k,,—Cckgo, 
the moments of y can be found precisely, without any infinite expansions. Then, using an appropriate 
graduating curve based on these moments, the probability that y exceeds zero can be estimated. 

P{y > 0} can then be compared with «. 


2. DERIVATION OF THE MOMENTS OF ff = k,, — Che 


We have E(s) = Ky, — CK a9 (5) 
and (Yr —E(ys))® = (Heyy —Kyy)® — 2e( heyy — Ky1) (a9 — K a0) + 6% ego — Keo)? 
= POE 1) ~2e«(1 5) +e%(5 6) 
. 3 10 0 0}* 
1 2 111 2.1 2 122 222 
Similarly pais) = «(1 : 1) = Bex( , 0) + 8e%(; 0 0) cK K(¢ 0 o}* 


xivye eS Se aed dh A 2) peed? 144 acta 2 22h aeuel4i4.4.4 
= a) ™*\1 110) 1 100 1000 0000)" 

These expressions can be evaluated, in terms of population cumulants, from tables of bivariate 
k-statistics (Cook, ath Thus we have 





1 1 1 2 1 2 
BAY) = Kyat xy Koken t as | es t1—2o( = Kato ail = wn) +c (Ket a a th), (6) 
6 3 3 3(n— —2) 
bs) = ne siesta Keak to Rakin ta Rank 1? Kai Xi2 
n—2 2 6 
n(n—1) KaoKos + pt G— ]p2 X11 “a0%or 
~3e( = kat Wiggs ad Kg) Ky, + ———~ Ko Kon + uel 
n(n —1) n(n— 1) n(n—1) n(n — 1)? 
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2 “20% unt Gaye 0% htt 71) K30Kos 





n(n — 
:. * 4(n— 2) 
: K : 
a in— 1 40X11 nin n—1)? 
1 12 (n—2) 
—c3| — Keg + ———— Kx xi). 
(00+ a Keke + oa at a) 
The expression for x,(y) was evaluated in a similar manner. It is not recorded here because of its 
length. 
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3. THE POSITION IN LARGE SAMPLES 


As the sample size increases we know, from the Central Limit Theorem, that the distribution of y will 
tend to normality. It follows that, in the limit, the probability that y exceeds zero can be determined 
by referring the limit of the ratio @(y)/o(y) to the normal probability scale. 

Using equations (4), (5) and (6) 


lim E(y) “se KeoKon — Kit \ 
no OY) °K aoKag— Kin + K ag — 2K 11 Kg1/K a9 + Keo Kia /K90 
where t¢,,, is the standardized normal deviate corresponding to an upper tail area of a. 


It follows that, for large samples, the distribution of the regression coefficient is the same as for a 
bivariate normal parent distribution for all parent distributions for which 





(8) 


Kegkgo+ Keak, = 251 Ky Kg0- (9) 

Using K. Pearson’s (1925) condition for linearity of regression with the addition of the condition for 

homoscedasticity of arrays it can be shown that equation (9) is satisfied by all distributions in which 
the regression of y on z is linear and the y arrays are homoscedastic. 

Equation (9) is satisfied also by any distribution with zero fourth-order cumulants. This includes the 

third-order Gram-Charlier surfaces, considered by Cook (19516). Her conclusion ‘that distortion in the 


way described...of the normal parent population is unlikely to lead to error in tests of significance’ 
is thus confirmed for large samples. 


4. THE POSITION IN FINITE SAMPLES 


To investigate the effect of non-normality upon the distribution of the regression coefficient in finite 
samples it is necessary to insert numerical values for the population cumulants into the expressions for 
the cumulants of y. It will be found that x,(y), «,(y) and «,(y) contain population cumulants up to the 
4th, 6th and 8th orders, respectively. , 

While it has been found that, in univariate distributions, the main forms of departure from normality 
met in practice can be adequately specified in terms of the ratios x,/«x! and x,/«?, the position is very 
different in the bivariate case. If we go only as far as the 4th order, there are fourteen bivariate cumu- 
lants, eight of which are determined by the marginal distributions, and the remaining six by the form of 
association between the variables. Until much further investigation has been carried out on the values of 
standardized bivariate cumulants and the relations between them found in observed distributions no 
adequate study of the sensitivity of regression and correlation theory to departure from normality is 
possible. 

Here, just a single example is used to illustrate the theory, taking a mathematical function to repre- 
sent the population distribution and so eliminating the effect of sampling fluctuations which may make 
the higher cumulants of observed distributions seriously unrepresentative. 


5. APPLICATION TO A DISTRIBUTION OF BAROMETRIC HEIGHTS 


The population used is the mathematical surface fitted by E. C. Rhodes (1923) to a bivariate dis- 
tribution of barometric heights recorded simultaneously at Southampton and Laudale. The form of 
equation was suggested by the fact that the original data are bounded, roughly, by two intersecting 
straight lines. The surface is defined by the equation 


z y\?(,,2 y\* 
= z,e~#-mv (1-42) (14—- 2) , 10 
z= Ze ( = +4) ( +5 ¥) (10) 


the exponential term being introduced to ensure that, for x, y large, z should tend to zero. 

The characteristics of this surface are: (i) increasing standard deviation in y-arrays as x increases, 
and vice versa; (ii) marginal distributions that tend to Type III curves as the correlation approaches 
unity; (iii) regression that tends to linearity as the correlation approaches unity. 

In the case of the barometric heights distribution the correlation is + 0-78, and the regression is 
approximately linear. 

If, following Rhodes, we define 
-. ¢ = ol = p’ + 
a’p’ b’p’ p+l 
then the standardized cumulants of Rhodes’s surface are given by 

(i+j —1)1(0%f* +A) 


s=g+l, O= 











Ki; = gii+s—292 4 Aya (G2 +A)” (11) 
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There is no loss of generality in standardizing the surface, so far as the comparison of the distribution 
of the regression coefficient with the normal theory distribution is concerned. 
Rhodes’s calculations gave the following values for the parameters: 


8 = 11-88185; 6 = 2-831825; ¢ = 0-680439; A = 1-155645. 


These values were used to calculate the required cumulants of 4th order and above. For the 2nd and 3rd 
order cumulants the figures of the observed distribution, as given by Rhodes, were used. Three of these 
were found to differ slightly, in the second decimal place, from the values given by (11). All the cumulants 
were taken to two decimal places only, and are shown in Table 1. 


Table 1. Standardized bivariate cumulants of Rhodes’s surface 





Ky 0-78 Ky 0°26 Kso 0-23 Ke 0-25 Kg 0°53 
Kx «= s«O- 41 Ky, 0-17 Kg, 0-13 Ky, 0-13 Ky, 0°25 
Ka, 0:29 Keg 0-17 Kzz 0-11 Ke 0-10 Kee 0-15 
Ki, 0-31 K;3 0-24 Ke, 0-15 Ksz 0-12 Kss 0°14 
Kog (0°47 Kog 0°39 Ky 0-25 Ky 0-19 Ky 0-20 























The moments of the criterion, ¥, were calculated for three sample sizes and two significance levels 
both for Rhodes’s surface and for a normal surface. The expressions &(y)/o(y), 2,(y) and £,(y) were 








derived from the moments and are shown in Table 2. 


Table 2. The parameters of the distributions of the criterion yy, and the 
types of frequency curves fitted to them 





Normal surface 






























































io Sneeey significance 0-05 0-01 

Sample size, n ll 21 61 11 21 61 
E (yr) /o(y) — 1-408 —1-514 — 1-599 — 1-738 — 1-974 — 2-191 
By) 0-6372 0:1762 0-0241 0-6937 0-2658 0-0430 
BW) 3-981 3-422 3-116 4-106 3-488 3-129 

Type of curve fitted Sr Sv Su VI Sr Su 

Rhodes’s surface 

— ey significance 0-05 0-01 

Sample size, n ll 2i 61 ll 21 61 
E(y)/o(y) — 1-301 — 1-395 — 1-465 — 1-612 — 1-819 — 2-006 
BY) 0-9288 0-3279 0-0500 0-2004 0-4968 0-0875 
By) 5-194 3-980 3-271 5-397 4-124 3-303 

Type of curve fitted Su Sy Su Sy Sy Sy 
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Having found these parameters it was necessary to estimate the proportions of the distributions greater 
than zero. This was done using suitable frequency curves with the same parameters (remembering that 
/;() is negative). The type of curve fitted in each case is also shown in Table 2; nine were of N. L. John- 
son’s (1949) Sy type, two were log-normal (S;, in Johnson’s notation), and one a Pearson Type VI. The 
method of fitting used for the Sy, curves was that given by J. Draper (1952). 

It should be remembered that these curves have only the first four moments fitted and will not repre- 
sent the distributions of y precisely. It was to check the adequacy of the representation that a normal 
surface was considered as well as Rhodes’s surface. 

The proportions of the fitted curves greater than zero are shown in Table 3. 


Table 3. Comparison between normal theory and true significance levels 





























Normal theory significance level, « 0-05 0-01 
] | ] | 
Sample size, n ll 21 61 (oe) ll | 21 61 | fee) 
a | | | 
Approximation to true significance level: | 
Normal surface 052 | -051 | -050 | -050 | -009 | -010 | -010 | -010 
Rhodes’s surface -062 | -062 | -064 | -063 016 | -014 | -015 | ‘O15 





For the normal populations the proportions would be 0-05 and 0-01 precisely if the fitted curves 
followed the exact distributions of y. In fact, the variation from these values is slight. 

Also shown in Table 3 are the values to which these proportions tend as sample size increases, derived 
by assuming that y is normally distributed and using equation (8). 

These results show that the approximate true significance levels for the finite samples for Rhodes’s 
surface vary from the infinite sample limits by no more than the levels for the normal surface vary from 
their limits. It thus appears that, for sample sizes from 11 upwards, the discrepancies in these particular 
significance levels due to non-normality are constant, and can be calculated, using equation (8), from 
a knowledge of six cumulants only. It is possible that this remains true for even smaller samples but this 
has not yet been investigated. Whether this constancy is a general law or a freak result due to some 
characteristic of the particular population chosen also requires further investigation. 

Whether the size of the discrepancies is to be considered as seriously affecting the validity of signi- 
ficance tests will depend upon the particular problem for which the tests are used. Certainly it would 
not be unreasonable to regard the 50% increase in the 0-01 level as of importance, and it should be 
remembered that for higher significance the relative discrepancy becomes larger. 


I wish to thank Dr F. N. David and Prof. E. S. Pearson for advice and help during the preparation of 


this paper, and to make acknowledgement to the Chief Scientist, Ministry of Supply, for permission to 
publish it. 
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Probability distributions arising from points on a line 


By P. V. KRISHNA IYER, Defence Science Laboratory, New Delhi 
AND M. N. KAPUR, Indian Council of Agricultural Research 


For n points on a line possessing any one of two characters A or B with probabilities p and g respectively 
Wishart & Hirschfeld (1936) have considered the distribution of the number of links like AB and BA 
for adjacent points. Iyer (1951) has obtained the difference equations satisfied by the probability and 
moment-gencrating functions (p.g.f. and m.g.f.) of a number of distributions similar to those discussed 
by Wishart and Hirschfeld when the points can assume more than two characters. In such cases the 
gencral solutions of the m.g.f. (or p.g.f.) cannot be obtained as it may not be possible to get the roots of 
the characteristic equations. The writer derived the cumulants for these cases by an independent 
approach without making any use of the difference equations. The object of this note is to show how the 
cumulants can be evaluated with the aid of the characteristic equations. 

We shall take for simplicity the case of three characters A, B and C occurring with probabilities 
p;(t = 1, 2,3). Then the difference equation of the m.g.f. for number of adjoining links AB, BA, AC, 
CA, ete., reduces to 


M(n+3)—M(n+2)—(6?—1) Up, p,M(n+ 1) +p, p2ps(36%— 26° — 1) M(n) = 0, (1) 


where 9 = etand M(n) represents the m.g.f. for n puints. 

We note that, for t = 0, two roots of the characteristic equation of (1) are zero and the third root is 
unity. This property holds good for the characteristic equation of many other distributions which arise 
from considerations of complex chains. If A,,A, and A, are the roots of the characteristic equation of (1) 


M(n) = A, AT + A,Aj +433, (2) 
where A,, A, and A, are obtained from 

M(1) = A,A,+A,A,+ Az, 

M(2) = roca (3) 


M(3) = A,Aj+A,A3+ Az A5. 
Now it can be easily seen that 


M(1) = 1, | 
M(2) = (1 — 2ip,p,) + 2ip,p,9, (4) 
M(3) = {1—32p,p,( p, + Ps) — 6P1 P2Ps} + 2p, Ps Pp + Ps) 9 + {671 P2Ps + LPs Pol Py + Ps)} F?. | 


Further log M(n) = log(A,Aj+A,A3+A3A3) 
Ay [As\" Ag (As) ‘ 
a log Ay +nlog A, +1og {1 > (2) a (2) 


K. K rp 
= Kt+SP+Se+..., (5) 


2 3! 


where A, is the root not equal to zero for ¢ = 0. By differentiating (5) r times it follows that 


d’ d’ 
K, == [ ies | +n log a] (6) 


sft ty NTL. 
joes —| log 1+" (>) +2 (> ag 
because dt’ [ os | + A, (>? ar A, t=0 


for all admissible values of r. 
Thus x, can be evaluated provided 


a d’ 
—logA and (> lo; a) 
(5 og i. at’ BA ¥. 
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are known. Now it can be seen that 








M(1) A, A; 
M(2) AQ AS 
3 3 
ee me M(3) Ag As By » A (7) 
Ay Ay A v 
AR AE AG | 
Ai. Ag AG | 
where u = A? +{M(2)—1}A,+{M(3) — M(2) — (62-1) Zp,p,} 
and v = BAZ— 2A? — (62—1) A, Lp, p,. 
Differentiating the characteristic equation of (1) in succession and putting ¢ = 0, we get 
Ay = 22p,P,, 
At = 671 P2P3 i 4=,P, ~ 8(Zp,p,)*, 
Ai = 30p, pep, + 8Ep,p, — 48(Lp, p,)* + 96(Lp,p,)® — 108p, Pe P3 LP, Py» (8) 


AY = 114p, pgp, — 576p, pp p4(2Up, p,) + 720p, PePs(2Up, p,)* 
— 432p? p? p? + 16Lp,p, — 224(Lp,p,)* + 144 x 8(Lp,p,)* — 120 x 16(Zp,p,)*. 


Also for t = 0 
u’ = 62p,p,, 
u” = 10Zp,p, + 18p, Peps, 
u” = 78p, py Ps — 54 x 2p, pyPs(Xp, P,) + 18Lp, p,— 12(Xp, p,)* + 48(Xp, p,)*, (9) 


ul” = 270p, paps — 1224p, pp5( Lp, p,) + 648 x 4p, pyps(Lp,P,) 
— 648p? p? p? + 342 p, p, — 96(Lp, p,)* + 84 x 8(Lp,p,)* — 72 x 16(Lp,p,)*, 


v’ = 82p,P,, 
vw = 30p, PeP3+ 162p, p, + 8(Zp,p,)*, 
v" = 150p, pops — 369, Py P4(2Lp,p,) + 32Lp, p, + 48(Lp,p,)*, (10) 


vo” = 5710p, PyPs — 1768p, PaPs(Lp,P,) + 1728p, P_Ps( Lp, Ps)" 
— 648p? p? p? + 642 p, p, + 224(Xp,p,)* — 384(Lp,p,)*. 
Using (8), (9) and (10) we get 
K, = 2(n—1) Xp,p,, 
Ky = n{6p, P_p, + 42 p,p, — 12(Lp,p,)*} + { — 12p, ppp — 6Up,p, + 20(Lp,p,)*}, 
ks =n{30p, pops — 144p, p,p, Lp, p, + 8p, Pp, 
— 72(Lp,p,)* + 160(Xp,p,)*} + { —72p, Peps + 360p, Paps Up, P, 
— 142 p,p, + 144(Xp, p,)? + 352(Lp,p,)*}, 
kK, = n{114p, paps — 1536p, pp, Lp, p, + 4320p, pyps(Zp,p,)* 
— 540pi pips + 16Lp, p, — 336(Lp,p,)* + 1920( Xp, p,)* — 3360( Zp, p,)*} 
+{— 3800p; pops + 4272p; Ppp Up, P, — 12672p PsP =P, Ps) 
+ 1728p? p32 p? — 30Lp, p, + 740( Lp, p,)* — 4704(Lp,p,)* 
+ 8928(Xp,p,)*}. 


It may be noted that the above values after reduction tally with those given by one of the authors earlier 
(1951). 
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The factorial moments of the distribution of joins between line segments 


By JOHN WISHART 
Statistical Laboratory, University of Cambridge 


The preceding paper by P. V. Krishna Iyer will recall to readers the method used by Wishart & Hirsch- 
feld (1936) for finding the cumulants of the distribution of joins between line segments when the segments 
are of two kinds only, e.g. black or white. Even in this simple case, while an explicit expression could be 
obtained for the moment-generating function (since the characteristic equation was quadratic and 
could be solved directly), it was not possible to write down general expressions for the cumulants of the 
distribution, nor for the moments about the mean. Instead, the two additive parts of the logarithm of 
the moment-generating function M,(t) were expanded as far as the terms in ¢*/4!, thus enabling the 
first four cumulants to be written down. Further work on generalizations of the problem, e.g. by Krishna 
Iyer, has likewise been limited to working out the first four cumulants. 

Now this distribution is an example of a class of discontinuous distributions (of which the binomial is 
a very simple example) for which it is much easier to obtain general expressions for the factorial moments 
than for the moments about the mean or for the cumulants. Recently, in lectures, the author has been 
giving a new version of the old proof which produces the factorial moments, and it may be of some 
interest to put the results on record. 

In the paper cited, the mean number of joins was first worked out and then, following this, the 
moment-generating function of moments about the mean was written down (p. 229, eq. (10)). If we 
consider, instead, moments about the origin, it is easy to see (indeed, this is implicit in the proof of the 
lemma on p. 233) that the recurrence formula for the mement-generating function has the simpler form 


Mr+s(t) = My (t) + pa(e*— 1) M,_,(2). (1) 


By repeating the argument in terms of factorial moments, or, in the alternative, by writing e' = 1+win 
(1), we obtain the equivalent recurrence formula for the factorial moment generating function in the form 


Mnsi(4) = Miq(u) + pqu(u+ 2) Miy_1{u). (2) 
As before, we may write down the solution as 

M,,)(u) = ¢,a"+0,5", 
where a and b (functions of u) are the roots of the quadratic 

x? —x—pqu(u+t 2) = 0. 
Thus a,b = $[1+{1+4pqu(u+ 2)}]. 
Now it is easy to see by direct computation that 

Mau) =1, Me(u) = 1+ 2pqu. 


These results enable us to determine c, and c,, and we then have 








a"—b6" a"-1— §-1 
M,,)(u) = gas + ip; (3) 
We note that at+b=1, a—b={1+4pqu(u+2)}, ab = —pqu(u+2). 


The first term in (3) may be expanded in the form 


a"™— 6" = 1-("7*)a+("5°) ave ("") ot +..., 





a—b 1 
for which the general term is obvious. By writing n— 1 for n we have the appropriate expansion for the 
multiplier of 2pqu in the second term of (3). We then combine and simplify. Since the rth factorial 
moment /4/,, is the term in w’/r! in the expansion of (3), we obtain the following formulae for the factorial 
moments of the distribution, depending upon whether r is odd or even: 


8=l (n—28+1\ (n—s—j—1 
, = 2(28—1)!( pa) : 
Pige-1) = 2(28— 1) (pay & ( 2541" ( eah-i 


=0 \ 
ae , se (n—28\ (n—s—j—1 - 
aay) = (20) (aq & ( 25 ) ( ag ) (40) ; 


) (4pay, 
(4) 
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The first four of these factorial moments, in a form capable of still further simplification, are 


fy = An—1) pq, 
—32 
Hy = 2pa{n—2+ ("5 ) soa}, 
—3 
Ms) = 12p%et{(n— 34+ 4 3 ) soa}, 


Ha = 2ap((">") +(n—4) Cx 4pq+ oy (402), 


whence the standard formulae expressing moments (and cumulants) in terms of factorial moments would 
enable the known results for the former to be reached without much trouble. 


REFERENCE 
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Note on the use of Sherman’s statistic as a test for randomness 


By D. J. BARTHOLOMEW 
University College, London 


1. INTRODUCTION 


1-1. In investigations of the randomness of occurrence of events in time or space the following 
problem often arises: Given n points on a line of unit length, are they randomly distributed along this 
line? This is equivalent to the formal problem of whether we can regard the n points yj, Yq, ---,Y, &8 
chosen at random from the rectangular population p(y) = 1 (0<y<1). 

Let 21, 2%, ...,%,4, denote the successive intervals between the points, so that 


n+1 
2 a= 1 (xy = min. (Ya)s Cas = 1— max. (y;))- 
int 
: 1+1 1 
Kendall (1946) suggested the use of the criterion w,, = 3 dX |a— — as the basis for a test of random- 
i=1 | 





ness. We note that 0<o, <n/(n+1). 


1-2, Itcan be shown that if t,, t,, ...,¢,,, are independent random variables with the common exponen- 
tial distribution 
p(t) =Ae~A* (¢t>0), 


1”+1 f 
then the criterion wu, = ; x | t,-7|{(n+1)3} 
i=1 
has the same distribution at 7,. Hence the common distribution may be used as a basis for tests based 


on either criterion. 


1-3. The moments and probability integral of 7, were obtained by Sherman (1950), who gave the 
following results: 


theta Kern Nom Te s oaendae (") (7 ) a (—)' (4-2). 
q=0 p=0 Pp} \qt+1 n n+q n+1 


where v is the integer satisfying v/(n+1)<x2<(v4+1)/(n+1), 


f _ (ntr\-9S} (n+1\ (r—1\ (n—s\"*" 
wa me (ry ECC. Ga) 


where g = min (r,n). 
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Expanding the moments in powers of n-! we have 


on ti 1 
w= 2 {1-5 +52 +0(5)], 


0-05908 0-07145 ( 1 ) 
= _ +0 ’ 





n® 





2 
n n* 


0-356 1 1-05 1 
Ariz +0). fg= Sone +0(5). 


2. APPROXIMATION TO THE DISTRIBUTION OF W, 


2-1. Calculation of exact percentage points is difficult. However, Pearson Type I curves fitted to 
the range of variation and the first two moments of w, give results which are in close agreement with 
the exact values where they are available. Table 1 shows values based on Pearson Type I curves compared 
with exact values for n = 3, 5 and 10. It will be noticed that the approximation to the upper 5 % point 
appears to get worse as the sample size increases. As the distribution of w, tends to normality with 
increasing n we may expect the fitted values eventually to converge to the true values. An inspection 
of the other percentage points confirms this, and suggests that we shall make little error in judging 
significance by using the approximation. 


Table 1. True tail probabilities corresponding to percentage points of fitted curves 








Percentage point n=3 n=5 n=10 
Upper 5% 0-051 0-051 0-054 
Upper 1% 0-017 0-015 0-011 
Lower 5% 0-046 0-046 so 
Lower 1% 0-011 0-010 — 




















2-2. If it be assumed that the distribution of X, = w,(n+1)/n can be approximated by the Pearson 
Type I distribution 


1 
Xs) = Bey yy XE - Xa? (O<Xq<1), 
+t 2 
= VWyaXp 
then W,= nl X.) 3 


would be distributed approximately as F with degrees of freedom 1, ¥,. Table 2 gives the values of 
v, and v, forn = 3 ton = 20. 








Table 2 
n 3 4 5 6 7 8 9 10 11 
Vy 7-70 10-59 13-50 16-40 19-29 22-19 25-09 27-95 30°83 


Ve 10-55 15-27 20-09 24:95 29-83 34°75 39-67 44-55 49-50 








Vy 33-81 36-68 40-03 42-26 45-48 48-56 51-19 53-98 57-10 
Ve 54-53 59-44 65-13 69-33 74:05 79-76 84-28 89-06 94-40 









































558 Miscellanea 


2-3. In order to find a suitable approximation when n> 20, the 5% points of 2,5 were_obtained by 
three methods. The results are shown in Table 3. 


Table 3. Approximate percentage points for Woo 








Percentage Type I Gram-Charlier 
point Normal (2 moments) (3 moments) 

Upper 5% 0°4457 0-4473 0-4476 

Lower 5% 0-2722 0-2741 0:2742 




















It seems that the normal approximation is sufficiently accurate for most purposes if n> 20. If greater 
accuracy is required the Cornish-Fisher (1937) inversion of the Gram-Charlier series, leading to the 
result that 0-0995 


uw’ =u- Jn (u?—1), 





@,, — 0-3679(1 — jn!) 


h gn 0-3679(1 — in™ 
a 4 = 0-2421n-1(1 — 0-605n-3) 


is approximately a unit normal variable, may be used. This transformation gives good results even for 
n as low as 10. 


3. APPLICATION OF THE TEST 


3-1. Either tail of the distribution of w,, (or W,,) may be used in testing significance, according to the 
alternative hypotheses envisaged. Usually it will be high values of 7, that are regarded ‘as significant, 
indicating more irregularity than would be expected on the hypothesis of randomness. 


3-2. The data on accidents-in coal mines considered in detail by Maguire, Pearson & Wynn (1952, 
1953) are in a form suitable for the application of the 7, test. In Table 1 of their 1952 paper the intervals 
between accidents over a period of 26,263 days are given. We obtain a value W,9, = 0°4085. The corre- 
sponding value of u is 1-82, and u’ = 1-80. Regarded as a unit normal variable this is significant at the 
upper 5 % level. 


Maguire et al. applied Fisher’s g-test, which uses the greatest interval, and Bartlett’s M-test to the 
data without establishing significance. In later notes Barnard (1953) showed that Kolmogoroff’s statistic 
(D,,) gave a significant result, and Maguire et al. (1953) also obtained significance using the w?-test. 

From Table 3 of the 1952 paper we find, for Division 4, a, = 0-3814. For n = 15, our Table 2 gives 
v, = 42-26, v, = 69-33, whence W,, = 1-12. Referring this value to the F-tables we see that it is not 
significant. The exceptionally long interval of 98 days is not sufficiently long to affect the significance 
of w,,. 


3-3. @, has been calculated for a number of other sets of data, including the remaining tables given 
by Maguire e¢ al. The conclusions reached were generally in accord with those based on other tests. 

In order to assess the value of the w,,-test it would be necessary to compare its power with that of 
other tests. Under the conditions set out in § 1-1, where the intervals are consecutive, w,,, together with 
other tests based on intervals, takes no account of the order in which the intervals occur. In cases where 
order is important more powerful tests must certainly be capable of construction. If the intervals are 
not ordered, w, may be preferred among the available tests because of its ease of application. 


My thanks are due to Dr F. N. David and Dr N. L. Johnson for assistance in the presentation of 
this work. 
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Two early papers on the relation between extreme values and tensile strength 


By JULIUS LIEBLEIN 
National Bureau of Standards, Washington, D.C. 


Practically every writer (e.g. Epstein, 1948; Gumbel, 1954; Johnson, 1953; Epstein & Brooks, 1948) 
who makes a historical reference to the use of extreme values in tensile strength testing dates such 
application from Peirce’s paper in 1926, the statistical model for which is based on Griffith’s theory of 
flaws enunciated in 1920 (Griffith, 1920, p. 179). In the interests of historical accuracy, it therefore 
seems important to report any material that comes to light which would significantly affect the widely 
held belief concerning priority. The purpose of this note is to bring to light two apparently forgotten 
articles written by W. 8. Chaplin, Professor of Civil Engineering, University of Tokyo, that appeared 
in American engineering journals over 70 years ago and recently came to the attention of the writer.* 
The first (Chaplin, 1880) was published in Van Nostrand’s Engineering Magazine for December 1880 and 
was entitled ‘The relation between the tensile strengths of long and short bars’. The second (Chaplin, 
1882), appearing in Proceedings of the Engineers’ Club for 1882, bore the title ‘On the relative tensile 
strengths of long and short bars’, and was essentially an elaboration of the first. It will be sufficient to 
confine attention to the first of the two articles. 

This article essentially gave the basis of the application of extreme values to tensile strength. The 
author began by mentioning the applicability of the (Gaussian) ‘law of errors’ to the variation in 
strengths of individual specimens or pieces of a given size, and charecterized their dispersion by their 
‘probable variation’, i.e. probable error, where nowadays we would use standard deviation. He then 
showed that p” is the chance that each of n pieces of the same size would exceed a certain tensile strength 
if p is the probability that each piece exceeds it. He next considered the key question that was the 
purpose of the article (p. 442): 


Suppose that many pieces of cross section c, and length one inch have been tested for tensile strength with 
an average result S,, and a probable variation in one piece of P,; what will be the probable averaget strength, 
S,, of pieces of the same cross section and a length of n inches? 

Knowing the probable variation in a piece one inch long, we are able to construct the curve showing the 
probability of any and all variations in a piece of this length. From this curve we can obtain the probability 
that the piece one inch long will break between any limits of variation. The probability that an inch-piece will 
break above a negative variation — is 0-5+A,, in which A, represents the probability that the piece will 
break between 0 and —-z. In a piece n inches long there are n pieces one inch long; the probability that any 
one of these will break above —z being 0-5+A,, the probability that all of them will break above this limit, 
or that the strength of the whole piece wiil be at least Sy—«x, will be 


(0-5+A,)". 


As S,} is an average, it is as probable that a piece m inches long will break above it as below it; hence the 
probability that a piece m inches long will break above it is 0-5. We have then 


(0-5+4+A,)" = 0-5, 
in which A, is the unknown quantity. We easily obtain 
A,= Y0-5-0°5 or 24, = 2(30-5—0-5). (Italics inserted.) 


In (not very different) modern symbols and terminology this stated essentially that if (a) is the 
(Gaussian) probability that the tensile strength of a piece of given length is greater than x, then the 
probability that a piece n times as long has strength greater than y is [P(y)]". Putting [®(y)]" = 4 and 
using the appropriate normal tables yielded the median value of the strength y of a piece m inches long 
(of similar cross-section). The author then converted the relation [®(y)]" = 4 into a useful table and 
chart, and explained that if 4 were replaced by } in this relation the corresponding value of y would give 
the ‘probable variation’ (semi-interquartile range) for strengths of the long specimen. This theory was 
vompared with the results of tests on five specimens of annealed Japanese copper wire of lengths 
1, 4, 8, 12, 16in., and agreement of theory with experiment was found to be very satisfactory. 


* The writer is indebted to Dr Churchill Eisenhart for calling his attention to an old engineering text 
(Slocum & Hancock, 1906) in which these articles were cited. 

+ The meaning intended here is epparently ‘median strength’. J.L. 

} This should apparently be S,. J.L. 
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The italicized portion in the above quotation is the essence of the ‘weakest-link’ concept—the idea 
that a chain is no stronger than its weakest link. Moreover, the function [®(y)]" is recognized as essenti- 
ally the (exact) c.d.f. of the distribution of largest values in samples of size n ftom the normal distribution. 
Thus, while the idea of ‘weakest link’ is probably very old, Prof. Chaplin’s work appears to be the first 
to apply the idea statistically, through the use of extreme values, to the study of tensile strengths. 
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Two problems in sets of measurements 


By M. G. KENDALL 


Visiting Professor, Institute of Statistics, North Carolina State College and Division of 
Research Techniques, London School of Economics 


1. Dr W. J. Youden (1953) has recently considered some questions arising out of the editing and 
internal consistency of a set of measurements, and in personal discussion raised two problems the 
solutions of which are presented herewith. The first problem (the Angel Problem) is as follows: 

mn members are drawn at random from a normal population with unit variance. A benevolent angel 
tells us which is nearest to the true mean, and the others are rejected. What is the variance of the retained 
member? 

This is the problem as posed by Dr Youden, but the practical situation which suggested it is not 
exactly angelic. A number of laboratory assistants are given a standard experiment to perform. They 
replicate it and, knowing what the true result ought to be, each submits only his best result. What effect 
does this have on estimates of experimental error? 


2. Forn = 1 the varianceis, trivially, unity. Forn = 2the solution was obtained by one of Dr Youden’s 
colleagues at the National Bureau of Standards at Washington, Mr E. P. King. For n = 3 the solution 
was obtained by Dr H. Fairfield Smith at North Carolina State College, where I carried out this work. 


Below I give exact results for n = 4 and 5, an adequate approximation for higher values of n and an 
asymptotic result for large n. 


3. From considerations of symmetry we see that the mean of the variate is the parent mean, which 
we may take to be zero. The problem then reduces to finding H(x*) in the distribution of the smallest 
of nm members chosen from half the normal distribution, namely, 


e+. J) 
aF = [Aas (0<a<o). (1) 


x 
If r={ dF, (2) 
0 
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the distribution of the smallest member is 
dG = n(1—F)"“dP, (3) 
and the required variance is then v,, say, given by 
eo 
%, = i) nx(1—F)* dF. (4) 
0 
The only problem is now to evaluate these integrals. They closely resemble those studied by Hojo (1931), 
and certain relations exist between the two. I have not, however, succeeded in adapting Hojo’s integrals 


for the present purposes, except that when a result is known for odd n they can be used to find the result 
for the next highest even n.* Unfortunately, they do not take us up from an even n to an odd n. We have 


nao) eee [Sera 


By a partial integration with x e-# for one part this reduces to 


Vv, = 1—n(n—-1) (=)" [ser (| “ewar) = dx, (5) 
0 zx 


and, by a further partial integration, to 
_ 2 in fo 5 Ce) , n-3 
V, = 5 1) (n—2) (-) J e-ie (| e~t at) dz. (6) 
1 7, 0 2 


For n = 2 we have from (5) immediately 


2 
% = 1--, (7) 


2 
and for n = 3, from (6), %= 1—— (3—¥/3). (8) 


4. For higher n I used.a reduction formula obtained as follows: 


© ipfo n n-3 
Let P(a,n,p) = i) e~i" (| ei at) dz. (9) 
0 pez 
oP ad ait © a n—4 
Then —= -(n—3) [ ae Katp a (| e~i at) dx, (10) 
op 0 px 


which, by a further partial integration, gives after a little reduction 


oP 
=— (a4,n,p) = 





(n—3) (7\¥"-*  p(n—3)(n—4) 
_ = ——_—__._— P 2p*,n— 2, p). 11 
ép @+p* \2 mare es (1+ 2p*,n—2,p) (11) 
5. For n = 4 we use (10) to obtain 
QD 
— » 4, ee 
ap (a, 4, p) aaa 
When p = ©, P = 0, and we find, putting a = 3, p = 1, 
1 p P=) 1 
, 4,1) = —- tan“ —— ==, 12 
P41) = Fytan ta] = 31 a2) 
dh P ‘ ee. 
and hence, from (6), %4= ms 73° 
? s m\t 1 
We have at once P(a, 3, p) ={ e-tdz* dr = (5) —. 
0 2] Ja 
Hence, from (11 ° Pla,5 =2(5)'{ . + aa reall 
Pics donot ap P= N3) | aap (ap (a+ apy 


* It may be noted that Hojo’s values for the integral he calls S (1931, p. 326) are in error, 
apparently by the omission of a factor 27. 
36-2 
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Integrating from oo to 1 and putting a = 3 we find 








P+ oe) 
P(3,5,1) = nas — tan 
(5.0) =2(5) | — eter 
ae =) {t =f a 
“30 " 4 
and hence v, = 1— My eta (ta an-+ [2 -7h. (13) 


6. For higher n the integrals become more complicated, and I have not succeeded in reducing them 
to elementary forms. Simple quadratures or expansions would, no doubt, evaluate them if the labour 
were thought worth while. 


7. An asymptotic result may be obtained as follows: In the original integral defining v,, as n becomes 


large the value 
2 4 to) - n-1 
ie) J." 
7 x 
2\*-1 2 
tends to (1-2, /=) ~exp{-(n—1y2,/7I, 
1 n 
2\% be 
Thus v.~ (=) nf 2 exp{- (n—1) e |=\ae~ n/n (14) 
0 


A better formula, derived from the expansion in the following paragraph, is 


=f Ste, 
(n—1)(n+4)° 


U,~ 


(15) 


8. The gap between the exact results and the asymptotic value may be bridged by an expansion due 
to Karl Pearson (1931, p. 361). In my notation his result, together with an extra term, is 


=F rt45 (2) Fe 13 7)" e+ (2) re 16 
a? +3 2 93 +315 2 Fe +.... (16) 


On substitution in (4) we find 








ee . ( 
* 2\(n+1)(n+2)° (n+1) (n+ 2) (n4 3) (n+4) \2 + +1) (nF 2)(n +3) (n+4)(n +5) (n+ 6) 2 


2816 1\3 
+oonee ny eres) } - 


For n = 4 this gives 0-1193 against the true value of 0-1208 and for n = 5 it gives 0-08261 against 0-08308. 
It would seem to provide, therefore, a satisfactory approximation for higher n and it agrees with the 
asymptotic formula. The approximate values below may be in error of 2 in the last place form = 6 and lin 
the last place for n = 7; the remainder should be accurate to the, places given. 


9. Table 1 gives the values of v, together with some sampling results obtained by Dr Youden. The 
agreement with experiment is reasonably good. 

Dr Youden’s samples are not all independent, in the sense that the material for sets of 10 was con- 
structed from the 200 sets of 5 by pairing them and choosing the smaller of the two smallest values in 
the sets of 5. For the purposes of a general comparison, however, this is not important. The variance of 
the mean of a sample of n being 1/n, the effect of choosing the closest member is to reduce the variance 
by a factor approximately equal to 7/(n + 3). 





10. Dr Youden’s second problem (the Demon Problem) is as follows: given a (small) sample of 
n values from a normal population, what is the probability that their mean lies between the nth and the 
(n— 1)th in order of magnitude? 

The problem is trivial for n = 2 and 3, and not of much interest for n>10. I shall give a general 
method of solution and obtain the probabilities explicitly for n = 4 to 10. 
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Table 1. Values of v, 








Approximate Asymptotic 
n Exact (eqn. (17)) (eqn. (15)) Sample value 
2 0-3634 — — — 
3 0-1928 — — 0-189 (200 samples) 
a 0-1208 0-1193 — 0-122 (200 samples) 
5 0-08308 0-08261 0-08727 0-0927 (200 samples) 
6 — 0-06065 0-06283 — 
7 — 0-04647 0-04760 —_ 
8 — 0-03676 0-03740 0-0374 (100 samples) 
9 _- 0-02982 90-0302 — 
10 — 0-02469 0-02493 0-0303 (100 samples) 
20 — 0-006880 0-006889 0-00768 (90 samples) 























11. The deviations of order statistics from their mean are independent of the mean itself in normal 
samples. If 


X = 4,—%, (18) 
we then have that the c.f. of x;—% multiplied by the c.f. of Z is the c.f. of x; and hence for the cumulants 
K(X) = «,(z;) (r= 1,3,...), (19) 
1 
K(X) = Ky(2j)— = (20) 


This result is due to McKay (1935) who arrived at it by a longer route. 
We can also use McKay’s method to obtain an explicit form for the frequency function, but as I found 

it rather troublesome to handle and have adopted a different approach I record the result without giving 

the details of the derivation. If 

an*( 1— O_)"—4 














= : 21 

AC) = BG.n—j+1) ce 
1 & ‘ 
where, as usual, “2, =— e~i dt, 22) 
—o 
the frequency function of X is 
1 n \t (ae. lIn-1 nX 

———— anit oneness 2 era 2 2 

san (x75) exp ( Sani?) xP ( 2 nt p+) 4("*), (23) 


d 
here D=—. 
where _s 


12. It is also interesting to note that McKay’s result expressed in (19) and (20) has a converse. In 
fact, if these expressions are true for any one n and for all the order statistics z,, the distribution of 
% is independent of all the deviations x;--Z and hence of the variance. Thus equations (19) and (20) are 
true only for normal variation; for the independence of mean and variance is a sufficient condition for 
parent normality. 

13. I proceed by finding the moments of x,_,, hence those of x,_, —-%(= X), hence the cumulants of X, 
and hence Prob. (X > 0) from the Edgeworth form of the Gram-Charlier expansion. 

The moments of the extreme member of a normal sample have recently been well tabulated by Ruben 
(1954). The distribution of the next-to-the-largest-value is 


d@ = n(n—1)(1—a)a*-*da, (24) 
and hence the moments about zero are given by 
fy, = n(n— 1) E{at(1—a) a*-%} 
= nM,(n—1)—(n—1) M,(n), (25) 
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where M,(n) is the rth moment of the extreme value is samples of n as tabulated by Ruben. The use of 


(26) then gives us the moments we require; and for the standardized cumulants of X I find, as far as Kk, 
(Table 2). 
































Table 2 
Values of n Ky Ks Ks Ks Ke 
4 0-893,675 0-386,480 0-467,153 0-158,270 — 0-421,023 
5 1-482,339 -501,767 -457,020 -247,879 — 212,405 
6 1-909,858 -537,666 -450,896 -296,310 — 074,065 
7 2-244,373 -547,896 -445,470 *325,307 -022,561 
8 2-519,644 -548,365 -440,794 -344,593 -093,139 
9 2-754,160 -546,647 -436,932 -358,530 *147,552 
10 2-958,969 -543,163 -433,825 -369,352 — +190,471 
The distribution function of X is 
] Zz 
F(X) = san} exp ( — }¢* dt) — $x, D? + 9x, D® —zhgx,D*+ (eho, t+ Fed) Dé +..., (26) 
—o 
where D? is given by (3) ales e| (27) 
dt} ./(2n) tnx 


For example, with n = 4, I find 
Prob. (x; >) = 0-1743. 


Thus the probability that the sample moan falls between the third and fourth observations (or between 
the first and second) is approximately 0-1743, and the probability that it falls between the second and 
third is 0-6514. Dr Youden has kindly supplied the results of a sample of 7000 which give proportions 
0-1744, 0-6546, 0-1710 falling between the first and second, second and third, third and fourth observa- 
tions respectively. These are well within sampling limits, yielding a y? of 0-54 with 2 degrees of freedom. 

14. Asymptotic results are not of much interest, but it may be worth recording that from (23) we can 
ascertain that the probability of the sample mean falling between the greatest-but-one value is, in the 
limit, n/2*. This is in accordance with the known result for the probability that the true mean lies between 
those two sample members. 

15. The distribution of X does not tend to normality for large n, and the Edgeworth series may there- 


fore become less satisfactory for larger n. The following are the probabilities calculated from (27) on the 
basis of the terms there shown: 


n 4 5 6 7 8 9 10 
P 0-174 0-078 0-040 0-024 0-015 0-010 0-007 
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REVIEWS 


Exercises in Theoretical Statistics. By M.G. Kmnpauu. London: Charles Griffin and 
Co. Ltd. 1953. Pp. vii+179. 20s. 


Statistical Tables and Problems. 3rd edition. By A. E.Wavuex. London: McGraw- 
Hill Publishing Company Ltd. 1953. Pp. xiv+242. 25s. 6d. 


In mathematics, as possibly in no other subject, must the student learn by repetition. A theorem 
containing a basic piece of information is proved; it is then vital to the student thoroughly to digest this 
information by practising its application in as many w« v= as he can find. ‘L’ Appetit vient en mangeant’, 
and understanding grows only with seemingly unnecessary repetition. Mathematical statistics theorems 
are newcomers to the corpus of mathematical knowledge, and exercises and examples, which have been 
thought out through the centuries in other branches, are difficult to come by. Until 1946 the only source 
for the student was the examination papers set in the various degree examinations of the University of 
London. Since then we have besides this source the examination papers of the Oxford, the Cambridge 
and the Royal Statistical Society diplomas (to mention a few newly sprung examinations.) 

Prof. Kendall has done students a service by collecting from published examination papers such 
questions as seem to him useful and by adding some of his own invention. There are 100 questions each 
on distribution theory and on sampling, 75 questions on statistical relationship, 75 on estimation and 
inference and 50 on time series. Hints for solution are given at the end of the book. The questions are 
uneven in that some are quite hard while others are easy, but taken as a whole the book will prove useful 
to the teacher and helpful to the student. 

Prof. Waugh’s book of tables and probiems is intended principally for the statistics student as opposed 
to the would-be mathematical statistician whom Prof. Kendall must-envisage. Prof. Waugh gives 
exercises on graphical presentation, significant figures, frequency distributions, measures of central 
tendency, measures of dispersion, probability and the normal curve, measures of reliability, and on 
correlation. The scope and standard of the exercises are such as to render them suitable for a class of 
students just beginning to learn statistics. No theoretical derivation is involved and the vue of a 
calculating machine is desirable to lighten arithmetical labour. Probably the book will be found useful 
to teachers beginning a statistics course ab initio and to non-university students who are trying to learn 
by themselves. Answers do not appear to be given. 

The tables, which are presumably included in order that the student may carry out the exercises 
without reference to outside publications, are the usual statistical collection with short auxiliary tables 
like those given in Barlow plus tables of the Perpetual Calendar and the Julian Day and a list of the 
Greek alphabet. F. N. DAVID 


Sampling Techniques. By W. G. Cocuran. New York: John Wiley and Sons Inc.; 
London: Chapman and Hall. 1953. Pp. ix+330. 52s. 


Prof. Cocran’s book deals entirely with that aspect of statistics which concerns itself with what are 
sometimes called sampling surveys, a somewhat narrower field than the title of the book might suggest. 
It is clearly written, with lucidity and logic in the development of the ideas put forward, and will take 
its place with the ot..r vade-mecum of the would-be sample surveyor, Deming on Some Theor; of 
Sampling and Yates on Sampling Methods for Censuses and Surveys. : 

The book begins with a short discourse on the advantages to be gained by using valid sampling 
techniques. We then start immediately on sampling from a finite population with the standard errors 
of various estimates worked out. There is some discussion on the validity of the normal approximation 
for the sample mean even when the sampling fraction is not small. Rarer still in such statistical literature 
as this, there is also a recognition that non-normality in the population may make a difference to the 
distribution of the variance, although we are left a little uncertain as to what use we should make of this 
information except to be cautious. 

Chapters follow on sampling for proportions and percentages, the estimation of sample size, stratified 
random and systematic sampling, ratio and regression estimates, double sampling and sources of error 
in surveys. The whole field appears to be well covered; authors from whom the various techniques 
originated are acknowledged in the text and a full reference given at the end of each chapter. This 
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enables the student wishing to find out things for himself to go to the first beginnings. Also at the end of 
each chapter are exercises with solutions at the end of the book. 

The would-be worker in sample surveys will find his subject presented with freshness and imagination 
in Prof. Cochran’s book. This is perhaps somewhat surprising in view of the well-trodden track to the 
well, created by both theoretical and practical workers in the past ten years. However, in this book 
everything that could and should be said has been written down. The applied statistician will find the 
discussion and results useful; the theoretical statistician wil! find out where to go in the literature in 
order to develop his own problems a stage further. Perhaps the one flaw is in the algebraic formulation 


of the sampling problem which is not elegant. ¥. N. DAVID 


Statistical Tables. Edited by the Research Association of Statistical Sciences, Kyusyu 
University, Japan. Tokyo: Kawade Publishing Co. 1952. Pp. v +264 (text) +214 
(tables). 


This is a handsomely bound book of tables with an extensive Introduction, which, judging by the single 
page in English entitled ‘Acknowledgement’, and notes on the actual tables, is a compilation of a large 
number of statistical tables reproduced with permission, from many sources, together with a dozen or 
so original tables and diagrams which were prepared in Japan. The aim is obviously to have a compre- 
hensive set of al] tables likely to be frequently consulted by users of statistical methods. One-third of 
the tables and charts are taken from Tables for Statisticians and Biometricians, from Biometrika, or 
from Miss David’s table of the correlation coefficient; two are from Statistical Tables by Fisher and 
Yates, while the remainder of the reproduced tables come from misce!laneous sources, of which the 
text-books of Kendall, Fry, Rietz and Goulden may be singled out for mention. There is a slight bias 
among the more specialized tables on the industrial applications side. The tables are clearly printed 
(or photographed), and will undoubtedly prove of great service in their country of origin. 

The non-Japanese tables comprise, in brief, the following: factorials and log-factorials; binomial 
coefficients; Poisson terms and their sums; normal deviate given area, ordinate and area given deviate, 
ordinate given area; deviate, ordinate and sundry ratios given area; area, ordinate and differentials 
given deviate; percentage points of f ratios; test for outlying observations; for the maximum of a set of 
variance estimates; charts for the correlation coefficient; nomogram for r = tanhz; incomplete normal 
moment functions; y* percentage points, etc.; goodness of fit (Kolmogoroff) test; t, incomplete Beta and 
F percentage points; P, of sample; test of randomness in run theory; quality control test; tests on the 
distribution of range; ratios of factorial series and sundry constants. What appear to be the purely 
Japanese contributions comprise: table for likelihood solution of Type III distribution, sampling in- 
spection tables, goodness of fit (w*) test, power function chart and tables, chart (with tables) of 
binomial probability paper, tables of random numbers, random normal and random Beta deviates, 
orthogonal polynomials, Anscombe’s inverse sine transformation, binomial probabilities and sums, 
and the simple binomia] inverse sine transformation. 

The most extensive of the Japanese tables are 40-42, 43 and 46. The first set consist of 4 pages of 
random numbers, followed by 15 pages of what are called ‘random samples from a normal population’, 
presumably what are usually called random normal deviates, followed by 8 pages of ‘random samples 
from a Beta (i.e. Type I) distribution’. Table 43 is an extensive one of orthogonal polynomials. These 
contain the same figures as the well-known tables of Fisher and Yates, but stop at n = 51. In the early 
stages, however, they are more extensive; up to n = 15 the polynomials are tabulated to degree n— 1, 
while they go as far as the 9th degree up to n = 21 and the 7th degree up to n = 31. Tables 46-1 and 46-2 
contain the individual terms, and their cumulative sums, of the binomial distribution, up to n = 50. 
They are similar to other such tables which have been published, except for a curious omission of the 
central term for even n; such terms can, however, be deduced from the cumulative sums. 

The long introduction is in Japanese. After some 30 pages on basic mathematical statistical theory the 
plan is to devote separate sections to individual tables, or groups of tables. The discussion appears to be 
exceedingly comprehensive, and is well documented with references to the literature of the subject. 


J. WISHART 
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Tables for the Design of Factorial Experiments. By T. Krracawa and M. Mrromg. 
Tokyo: Baifukan Co. Ltd. Rutland, Vermont, U.S.A.: Charles E. Tuttle Co. 1953. 
Pp. x+ 292 (text) + 253 (tables). $15. 


This book contains 124 pages of theoretical introduction, 168 pages of description of tables, and eight 
sets of tables covering some 253 pages altogether. The introduction and description are in Japanese and 
therefore will not be read by many in this country. However, there is an exhaustive set of references, 
including many sources in English, and an index in Japanese and English. The tables themselves are 
annotated entirely in English and form a remarkably thorough collection of experimental designs. They 
are grouped as follows: 


(i) Latin squares and cubes. This includes all squares up to 5 x 5, and all transformation sets up to 
7x7, with examples of higher order squares. There are, further, sets of orthogonal Latin squares, 
orthogonal partitions in Latin squares, and the orthogonal Latin cubes up to 7 x 7 x 7. 

(ii) Factorial designs. A wide range of complete and balanced confounded designs. 

(iii) Fractional replications in factorial designs. Fractional replication of 2” in }, }, 4 and 4, replication, 
and $ replication of 3" designs. 

(iv) Factorial designs with split-plot confounding. 

(v) Factorial designs confounded in quasi-Latin squares. These include the various plaid and half-plaid 
designs. 

(vi) Lattice designs. 

(vii) Balanced incomplete block designs. 

(viii) Youden’s squares. 

The tables are not noticeably more complete than those in Experimental Design (Cochran & Cox)— 
except in the remarkably thorough documentation of Latin Squares. It is, of course, convenient to have 
all the designs tabled together. 

It is a pity that the introduction is in Japanese, for it appears to be an unusually painstaking com- 
pilation of theory and practice of the analysis of variance, including more recent developments, such as 
Pearson & Hartley’s power function charts, Hartley & David’s work on the use of range, and calculations 
on the results of applying various rules for pooling sums of squares. N. L. JOHNSON 
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